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INTELLIGENCE AT ADULTHOOD: 
A TWENTY-FIVE YEAR FOLLOW-UP! 


CLARE W. THOMPSON? 
Washington State University 


KATHERINE P. BRADWAY 
Stanford University 


AND 


This paper reports findings from 111 Ss tested with the Stanford-Binet 
(S-B) at preschool and adolescence who were administered the S-B 
and WAIS at adulthood. Correlations of preschool IQs with adult 
S-B and full WAIS IQs are .59 and .64; of adolescent IQs with adult 
IQs, .85 and .80. Mean S-B IQ increase from adolescence to adult- 
hood is 11 points, indicating that mental growth continues beyond 
16 years. Males show more IQ gain after adolescence than do females 
(p < .01). Girls with high IQs increase least. Analysis of increases 
in percent passing S-B items shows more growth after adolescence in 
abstract reasoning and vocabulary than in rote memory and practical 
reasoning. Preschool verbal and memory items are better predictors 
than nonverbal items of both verbal and performance adult IQs. 
Pattern of individual differences in relative amounts of these abilities 


shows some stability over 25 years. 


Attempts to understand human intel- 
ligence were based initially on studies 
of children. In contrast, this paper deals 
with aspects of intelligence which can- 
not be studied adequately from data 
limited to childhood intelligence. Spe- 
cifically, our approach has been to study 
as young adults a group of individuals 
previously tested during the preschool 
years and during adolescence (Bradway 
1944, 1945a, 1945b; Bradway & Robin- 
son 1961; Bradway, Thompson, & Cra- 
vens 1958). 

Binet and Simon developed the origi- 
nal intelligence test to objectify the cri- 
teria which educators had been using 
for many years in assessing the capaci- 
ties of children for purposes of school 


1This investigation was supported by 
USPHS Research Grant M-1273 through the 
National Institute of Mental Health, Na- 
tional Institutes of Health. 

2At Stanford University when participat- 
ing in this research, 


placement. The several early American 
adaptations of this test culminated in 
the 1916 Stanford-Binet, which pro- 
vided indices of adult intelligence. The 
standardization group, however, con- 
sisted largely of children; adult indices 
were based on extrapolation. 

The urgency of the needs for screen- 
ing and assignment created by World 
War I led to the creation of truly adult 
intelligence tests but, consistent with 
these needs, these tests were for group 
rather than ndividual administration. 
Later revisions of individual intelligence 
tests (e.g., the 1937 and 1960 Stanford 
and the 1939 Kuhlmann) extended the 
upper limit by providing more difficult 
test items. Moreover, somewhat older 
subjects were included in the standardi- 
zation groups, although the upper age 
levels of these groups did not go above 
the adolescent years into adulthood. 

No adequate instrument existed by 
which the clinician could measure the 


| | | 


2 


intelligence of the individual adult ‘until 
the publication of the Wechsler-Bellevue 
in 1939. Wechsler’s large standardiza- 
tion sample started with children of 12 
years and included older age groups up 
to 65 years. His emphasis on adult in- 
telligence resulted in departure from 
the use of mental age, a concept which 
had contributed immeasurably to the 
interpretation of childhood intelligence, 
but which introduced confusion in the 
assessment of adult intelligence. His term 
“IQ” is not a continuation of Stern’s 
quotient of mental age divided by 
chronological age; it is more comparable 
to a standard score. Unlike the revisions 
of the Binet, all of which had been 
based on the concept that intellectual 
abilities reach their peak at from 14 to 
16 years of age, indices of intelligence 
for the first time took account of the 
continuation of intellectual growth into 
the adult years. This view of intellec- 
tual growth has been increasingly con- 
firmed by more recent studies (Bayley, 
1955; Bayley & Oden, 1955; Miner, 
1957; Owens, 1953) including the pres- 
ent one. Although Wechsler calls his 
concept of intelligence global, the struc- 
ture of the Wechsler-Bellevue (and its 
later revision, the WAIS) is such that 
several kinds of tasks are separately 
measured and separate indices of verbal 
and nonverbal abilities are provided. 
The clinician trying to answer ques- 
tions about the intelligence of an adult 
needs information about the unique 
growth rates of different kinds of abili- 
ties. No cross-sectional sampling can 
provide such information accurately. 
On the other hand, longitudinal studies 
pose problems of practice effects and of 
the attrition which inevitably occurs over 
a period of time. The clinician is also 
confronted with the problem of how 
most meaningfully to express the meas- 
ured intelligence of any given adult. 
Should it be an index which compares 
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him with his own age group? One 
which locates him on his own course 
of development and decline? Or several 
which represent an assessment of his 
various kinds of mental processes? 
Moreover, each of these requires that 
procedures for equating means and vari- 
ability be worked out. Answers to many 
of these questions are necessary before 
valid predictions about adult intelli- 
gence can be made. 


PROCEDURE AND SUBJECTS 


Information for some of these answers is 
provided by the longitudinal study we have 
recently completed (Bradway & Robinson, 
1961 ; Bradway et al., 1958). A group of 111 
adults aged 27 to 32 who had been tested 
25 years earlier as part of the 1937 Stanford- 
Binet standardization sample of preschool 
children and again during their adolescent 
years (Bradway 1944, 1945a, 1945b) was ad- 
ministered the Stanford-Binet and WAIS in 
1956.3 The repetition of the Stanford-Binet 
permits analysis of improvement in the same 
tasks from adolescence to adulthood; the 
WAIS data permit comparison of child and 
adult measures of intelligence of the same in- 
dividuals. Treatment of the data has included 
correlations between total scores, mental 
growth curves, an analysis of items for in- 
crease in percent passing from adolescence to 
adulthood, and an analysis of the predictive 
value of preschool items. This latter item 
analysis was based on: correlations between 
Stanford-Binet (Forms L and M) preschool 
items and both adolescent Stanford-Binet IQ 
and adult WAIS verbal and performance 
quotients, and comparisons between scores on 
special scales constructed from the several 
kinds of preschool items and later scores 
obtained on comparable adult WAIS scales. 
Because for one subject the WAIS was in- 
complete and educational attainment was not 
ascertained, and for another the 1931 Stan- 
ford-Binet IQ was invalid, the number of 

3The authors are happy to express their 
gratitude to Maud A. Merrill and the late 
Lewis M. Terman for generously having 
made their standardization data available for 
follow-up; to Quinn McNemar, consultant 
and advisor throughout the study; and to 
Nancy M. Robinson who participated actively 
in the later stages of the study. 
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total subjects on which any one analysis is 
based varies from 109 to 111 depending upon 
which variables are involved in the analysis. 
No attempt was made in the two follow-ups 
to continue the procedure used in the initial 
examination of testing children within one 
month of a birthday; a larger deviation in 
the age distribution was a consequence. 


RESULTs AND DIscUSSION 


Constancy of the IQ 


A finding of primary interest is that 
an individual’s measured intelligence in 
relation to others of his same age is 
demonstrated to be more stable than 
previous studies suggest. These results 
are presented in Table 1. It will be 
noted that the correlation between pre- 
school (1931) intelligence, and adult 
(1956) intelligence as measured by the 
full scale WAIS is .64. The measure of 
preschool intelligence was a combina- 
tion of the two forms of the Stanford- 
Binet which became the 1937 Revision, 
and the measure of adult intelligence 
was a combination of the verbal and 


performance scales of the WAIS; thus 
the indices of intelligence at both ages 
were based on the most adequate meas- 
urements available when the data were 
collected. The reliability of each meas- 


urement was sufficiently high so that 
correcting for unreliability increases the 
correlation only slightly: from .64 to 
.69. The degree of correspondence over 
a 25-year period is not significantly dif- 
ferent from the correlation of .65 (un- 
corrected) found between preschool and 
adolescent Stanford-Binet IQs after an 
interval of 10 years. 

Also of note from Table 1 is the cor- 
relation of .80 between adolescent 
(1941) Stanford-Binet and adult (1956) 
WAIS. Although this is somewhat lower 
than the correlation of .85 between the 
adolescent and adult administrations of 
the Stanford-Binet, neither correlation 
is significantly different from the corre- 
lation of .83 between Stanford-Binet 
and WAIS administered to our subjects 
on the same day when they were adults. 
Apparently whatever the Stanford-Binet 
measures at preschool and at adoles- 
cence is still being measured by the 
WAIS at adulthood. 

A comparison of the columns of Ta- 
ble 1 shows a close similarity, both in 
absolute amount and in trend, between 
the 1956 verbal WAIS and the 1956 full 
scale WAIS when each is correlated 
with the Stanford-Binet administered at 
the three age levels. The performance 


TABLE 1 


CorRRELATIONS BETWEEN Test SCORES AT THE SEVERAL ADMINISTRATIONS 


1956 
S-B(L) . 


1941 
(L) 


1956 WAIS 
Performance 


1956 WAIS 1956 WAIS 
Full Verbal 


1931 65 59 
1941 S- 85 
(L) 
1956 S-B 
(L) 
1956 WAIS 
Full 


1956 WAIS 
Verbal 


80 . 51 
46 
84 
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WAIS correlations, on the other hand, 
are both lower in value and opposite in 
trend. The reason for this reversal in 
trend needs further study to determine 
whether the results reflect an increase in 
specialization of intelligence with age 
or are due to an increase in verbal con- 
tent of the Stanford-Binet at the higher 
levels. 


Growth and Decline of Intellectual 
Abilities 

Our data contribute to the accumu- 
lating evidence that intellectual poten- 
tial does not cease to increase at 16 years 
in contradiction to the conclusions of 
Terman and others. Table 2 summa- 
rizes our data for comparison of ob- 
tained IQs. In view of the conformance 
between the 1931 and 1941 Stanford- 
Binet IQs and between the standard 
deviations at the three ages, the fact 
that the 1956 Stanford-Binet IQ exceeds 
the 1941 Stanford-Binet IQ by a statis- 
tically significant amount is interpreted 
as a consequence of intellectual growth 
in these subjects beyond 16 years. The 
increase of 11 points in IQ corresponds 
to a gain in mental age score of 20 


TABLE 2 


MEANS AND STANDARD DEVIATIONS OF THE 
Two TEsTs aT THE THREE 
ADMINISTRATIONS 


1931 1941 1956 
Test 
SD| M | SD 
Chronological | 4.0 1.1 | 136 1.4] 295 15 
age 
S-B IQ 112.8" 15.9*| 112.3% 16.4% | 123.6> 15.0% 
WAIS IQ 
Full 108.9 11.0 
Verbal 110.4 13.3 
Performance 105.0 11.5 


* Composite Form L and Form M. 
© Form L. 


months beyond expectancy. The finding 
of a continuation of mental growth into 
adulthood is consistent with the findings 
of Bayley (1955, 1957) and others 
(Bayley & Oden, 1955; Miner, 1957; 
Owens, 1953). The implications of the 
difference between present and previ- 
ously held conclusions regarding mental 
growth into adulthood deserve consid- 
eration. Bayley (1955, p. 817) suggests 
alternative explanations including the 
new generations’ having more opportu- 
nity to develop their intellectual capaci- 
ties than did their parents. Inhelder and 
Piaget (1958, p. 337) have pointed out 
the probability that Greek children were 
behind our own in growth of logical 
thinking and suggest that the age at 
which formal thinking begins “may be 
a product of progressive acceleration of 
individual development under the influ- 
ence of education.” 

The method of computing WAITS IQs 
assumes continuation of intellectual 
growth up to 34 years. The mean 
WAIS IQ of our group is lower in 
numerical value than expectancy based 
on the mean 1941 Stanford-Binet IQ. 
It will be noted, however, that the 
WAIS mean IQ is approximately one 
SD above 100, whereas the 1941 Stan- 
ford-Binet mean IQ is less than one SD 
above 100; so that in terms of relative 
deviations, the WAIS mean IQ is higher 
than the Stanford-Binet IQ, although 
not to a statistically significant degree. 
The verbal half of the WAIS ap- 
proaches the 1941 Stanford-Binet results 
more closely than does the full -scale, 
and the performance half less so. 

The addition of the present data to 
those previously collected for this group 
of subjects gives us a third segment ‘of 
the mental growth curve. Thus we can 
plot mental age against chronological 
age for the years 2 through 5, the years 
11 through 15, and now the years 27 
through 31. Two subjects were younger 
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TABLE 3 


STANFORD-BINET ScorEs FOR ADULTS 
BY YEAR OF AGE 


1956 S-B S-B 
Chronological age N Mean 19561Q Mean 1956 MA 


121.3 18.2 
125.5 18.9 
126.8 19.0 
123.5 18.5 
121.0 18.1 


27.0-27.9 16 
28.0-28.9 25 
29.0-29.9 23 
30.0-30.9 20 
31.0-31.9 24 


and one was older than these years and 
are omitted from this section. Table 3 
summarizes the current data for the 
Stanford-Binet. 

Analysis of variance was applied to 
these data. The resulting F ratio was 
.594 for 4 and 103 degrees of freedom, 
whereas 2.45 would be required for the 
.05 level of significance. Of course, 
should the drop from age 29 to age 31 
continue in direction and amount, the 
critical point of this mental growth 
curve would have been established, but 
there is no way to predict this from the 
present data. 

Before we interpret what this lack of 
change during this 5-year period may 
mean, we must consider the possible 
ceiling effect. The 1937 Stanford-Binet 
has insufficient top for adults and there- 
fore this flattening of the curve might 
be an artifact. To examine this possi- 
bility, a similar analysis was made of the 
results on the WAIS for these subjects, 
inasmuch as a low ceiling is not a limi- 
tation of that test. One of the subjects 
had a partial WAIS only and is omitted 
for this reason, reducing the degrees of 
freedom to 4 and 102, but not changing 
the value of 2.45 for the .05 level of 
significance against which the results 
are compared. Table 4 summarizes the 
data for the WAIS. Analysis of vari- 
ance for these three scores again shows 


the variation with chronological age 
not to approach significance. The F 
ratios are, respectively, 1.40, 1.01, and 
1.62. 

Further study to determine the role 
of ceiling effect was made by analyzing 
only those cases showing no or few 
passes at the Superior Adult III level 
of the Stanford-Binet. Also, because our 
group of subjects is somewhat above 
average, a separate study was made of 
those cases clustering around IQ 100. 
These additional studies, however, 
served only to substantiate the results 
just reported. The point at which 
mental growth as measured by these 
instruments terminates and at which the 
curve assumes a downward direction is 


not established by these data. 


Sex Differences 


Tests such as the Stanford-Binet are 
intentionally constructed to eliminate or 
to minimize sex differences. Conse- 
quently most investigators, including the 
present ones in earlier studies, have 
given little attention to this variable. It 
is in this area, however, that some of the 
most cogent findings of the present 
study emerge. As shown in Table 5, on 
all three administrations of the Stan- 
ford-Binet, female subjects achieved a 
higher mean score than did males. On 


TABLE 4 
WAIS Scores ror ADULTs BY YEAR OF AGE 


Mean 1956 WAIS 
standard scores 


Full Verbal Performance 


1956 Chronological age N 


27.0-27.9 119 
28.0-28.9 127 
29.0-29.9 129 
30.0-30.9 126 
31.0-31.9 119 


TABLE 5 


Sex DirFERENCES ON THE STANFORD-BINET 


Test Male Female Difference 
1931 L-M 

N 51 59 

M 108.5 115.8 —7.3 

SD 14.4 13.3 

CR* 2.79 
1941 L 

N 52 59 

M 107.9 116.1 —8.2 

SD 19.0 13.7 

CR* 2.58 
1956 L 

N 52 59 

M 121.6 125.7 —4.1 

SD 19.6 10.6 

CR* 1.36 


*A value of 2.57 is significant beyond the .01 level 
and a value of 1.96 beyond the .05 level. 


the first two administrations, this differ- 
ence was significant beyond the .01 level. 
On the 1956 testing, it did not reach 
significance. The males increased their 
scores from 1941 to 1956 to a greater 
extent than did the women. For the 
males, this increase was 13.7 and for the 
females it was 9.6; the difference of 4.1 
is significant beyond the .01 level. Both 
females and males show a negative cor- 
relation between the 1941 Stanford- 
Binet IQ and the gain in IQ from 1941 
to 1956, but the one for females is 
larger. For men this correlation is —.23 
and for women —.67; the difference 
between these correlations is significant 
beyond the .01 level. Dividing the male 
and female groups according to whether 
they stopped their education at high 
school graduation or went beyond does 
not change the findings. The obtained 
correlations for males are —.28 and 
—.19 (not significantly different) ; and 
for females —.70 and —.65 (not signifi- 
cantly different). The decrease in stand- 
ard deviation for females from 1941 to 
1956 as shown in Table 5 reflects that 
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these findings are due to the tendency 
of women with IQs which are high at 
adolescence not to increase their scores 
by adulthood as much as does the rest 
of the group. ° 

_ A study of the individuals scoring 
high (from 130 to 150 IQ) on the 1956 
Stanford-Binet yields further informa- 
tion. Females in this group had always 
scored high relative to the group: mean 
IQ of 125.9 in 1931, 127.8 in 1941, and 
137.5 in 1956. For the males, however, 
becoming a member of this group repre- 
sented a gain from an earlier lower 


- point with most of the gain achieved 


by adolescence: mean IQ of 115.9 in 
1931, 126.2 in 1941, and 140.7 in 1956. 
(It must be remembered that these 1956 
Stanford-Binet IQs are, on the average, 
11 points high, since they do not include 
a correction for the fact that there was 
a mean IQ increase of 11 points for the 
total sample.) Slightly but not signifi- 
cantly more women than men in this 
subgroup stopped education with high 
school graduation. Of those who started 
college, not a single man failed to finish, 
whereas one-third of the women 
dropped out before finishing. This 
leaves us with the familiar chicken-egg 
dilemma. Did the women drop out of 
college because their relative brightness 
as compared with men decreased—their 
promise not being realized in the same 
way as was that of the men? Or did the 
earlier termination of their academic 
education make the intelligence tests ad- 
ministered to them as adults relatively 
more difficult for them? 

An analysis of the relation between 
IQ at adolescence and continuation of 
education for the total group was made. 
There is no significant difference for 
either sex between mean 1941 IQ of 
those who stopped their education with 
graduation from high school and the 
mean 1941 IQ of those who attended 
college but did not graduate (males: 
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100.7 and 102.5; females: 113.8 and 
113.0). The mean 1941 IQ, however, 
of both the 17 males and the 14 females 
who graduated from college is signifi- 
cantly higher (124.6 and 125.0, respec- 
tively) than for those who did not grad- 
uate from college. Gain in IQ, on the 
other hand, is not consistently related to 
educational attainment. Mean IQ gains 
for males who did not go beyind high 
school graduation, who entered college 
but did not graduate, and who gradu- 


ated from college were 14.7, 11.7, and 
11.8, respectively. Corresponding mean 
gains for females were 8.2, 12.3, and 9.3, 
respectively. The differences between 
the mean gains for either sex are not 
large enough to be statistically significant 
with the small number of subjects in- 
volved (males: 22, 13, and 17 for suc- 
cessive educational attainments; fe- 
males: 22, 22, and 14). 

Because other investigators of adult 
intelligence have not reported sex dif- 


TABLE 6 


Items oF STANFORD-Binet (L) ApuLT LeveLts sy MAGNITUDE OF CHANGE IN 
PERCENT PASSING FROM ADOLESCENCE TO ADULTHOOD 


Percent Passing * 
Location 1941 1956 


i 


Increase Chi square® 


E 


58.6 
57.7 
54.1 
51.4 
46.9 
43.3 
43.2 


76.26 
80.07 
67.28 
52.42 
49.04 
38.01 
52.84 


22.5 
35.1 
13.5 
31.5 


81.1 
92.8 
67.6 
82.9 
77.5 
73.9 
45.0 


Proverbs I 
Vocabulary 
Vocabulary 
Essential Similarities 
Sentence Building 30.6 
Ingenuity 30.6 
Vocabulary 18 
Difference between 

Abstract Words 49.5 
Opposite Analogies 8.1 
Codes 37.8 
Reconciliation of Opposites 
Vocabulary 
Proverbs II 
Memory for Sentences V 36.9 
Finding Reasons II 14.4 
Reconciliation of Opposites 54.9 
Arithmetic Reasoning 41.4 
Orientation: Directions II 14.4 
Minkus Completion 24.3 
Repeating 6 Digits 

Reversed 29.7 
Reasoning 3.6 
Repeating 8 Digits 17.1 
Repeating 9 Digits 3.6 
Paper Cutting II 11.7 
Enclosed Box Problem 50.4 
Repeating Thought of 

Passage 24.3 


AA-5 
SAI-1 
SAII-1 
SAI-6 
SAI-5 
AA-6 
SAIII-1 
AA-3 


1 
2 
3 
4 
5 
6. 
6. 
8 


48.05 
44.89 
35.73 
34.89 
49.41 
42.81 
27.63 
28.68 
26.64 
21.22 
20.15 
16.18 


91.9 
48.7 
77.5 
69.4 
98.2 
44.1 
72.1 
47.8 
86.5 
72.1 
41.4 
50.5 


SAIII-3 
AA-2 
SAIT-5 
AA-1 
SAII-4 
AA-7 
SAII-2 
AA-8 
AA-4 
SAITI-2 
SAI-3 
SAI-4 
13.45 
19.82 
9.34 
9.89 
3.57 
0.62 


54.1 
24.3 
35.1 
16.2 
22.5 
55.9 


SAITI-5 
SAII-3 
SAITI-6 
SAITI-4 
SAI-2 
SAII-6 


27.9 0.09 


*N=I11. 

®A chi square value of 10.83 is significant beyond the .001 level, 6.64 beyond the .01 level, and 3.84 at the 
05 level. Hence all but the last three items of this table show a significant increase in percent passing from 
adolescence to adulthood. 

¢ These refer to the classification of Davis and Robinson described previously. 


RA 
Vv 
RA 
5 RP 
5 ¥ 
42.4 Vv 
9 
10.5 RP 
10.5 RA 
12 Vv 
13 RA 
14 M ‘ 
15 RA 
16 RA 
17 RP 
18 RP 
19 Ve 
20 
M 
21 RP 
22 M 
23 M 
24 RP 
25 RP 
26 
M 
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ferences of the nature found here, we 
cannot look beyond our own data for 
the answers to some of the questions 
which are posed. This seems to open 
up an area worthy of further study de- 
signed explicitly to explore this problem. 


Increases in Abilities from Adolescence 
to Adulthood 


With the establishment of the fact 
that there is increase in intelligence 
scores between adolescence and adult- 
hood, one becomes interested in identi- 
fying the kinds of abilities which 
increase most. Within the range of abili- 
ties covered by the adult levels of the 
Stanford-Binet, it was possible to shed 
light on this question by comparing the 
proportion of our group passing each 
item as adolescents and as adults. The 
percentages of the present sample pass- 
ing each item were calculated for the 
1941 and 1956 results. Items occurring 
below a subject’s basal age were as- 
sumed to have been passed ; those occur- 
ring above a ceiling were assumed to 
have been failed. Since nearly all sub- 
jects passed in 1956 all those items 
through Level 14, it was possible to 
make meaningful comparisons for the 
four adult levels only. Table 6 lists each 
of the 26 items at these levels, arranged 
according to the magnitude of the in- 
crease in percent passing over the 15- 
year period. The final column in the 
table classifies items by “type,” following 
a system suggested by Davis (1941), in- 
to rote memory (M), reasoning (R), 
and vocabulary (V). The reasoning 
subscale has been further divided by 
Robinson* into those items which ap- 
pear to involve mental manipulation of 
practical, concrete concepts (RP) versus 
those dealing with more abstract con- 


*Nancy M. Robinson made several contri- 
butions to the treatment of data for this 
section of the study. 


TABLE 7 


ComPaRISON oF Four SuBSCALES ON IN- 
CREASE FROM ADOLESCENCE TO ADULTHOOD 


Rank order 
among 26 items 


Mean of 
increases 
in percent 
passing 


M | Mdn. 


Vocabulary a1 73) 


Reasoning 
Abstract 99 118 
Practical 17.4 18.0 


Memory 21.0 22.0 


cepts (RA). One might wonder wheth- 
er those items having the lowest percent 
passing in 1941 would by artifact show 
the most increase to 1956. The correla- 
tion between percent passing in 1941 
and increase from 1941 to 1956 was 
found, however, to be only .06. 

Table 7 presents a comparison of the 
data which demonstrates the differential 
increases made by our subjects in the 
four classifications of items. Immedi- 
ate rote memory items and those involv- 
ing practical reasoning showed smaller 
increases than those involving abstract 
reasoning and vocabulary. This finding 
tends to confirm the conclusion of most 
investigators that growth of functions 
dependent on continued learning and 
on the building of concepts is more like- 
ly to continue into adulthood than is 
growth of memory or performance 
functions. 

These data make it clear that one 
should not present conclusions about the 
growth of intelligence into the adult 
years without specifying what kinds of 
intelligence one means and how one is 
measuring these. If one administered 
an intelligence test consisting solely of 
items measuring vocabulary and ab- 
stract reasoning, he would find more 
increase of “intelligence” into adult- 


| 
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hood than if he used a test heavily 
weighted with memory and practical 
reasoning items. Thus one cannot real- 
istically expect ever to describe the 
shape of the mental growth curve. 

A finding in these data which has 
important implications when it comes 
to trying to predict amount of subse- 
quent mental growth in an individual 
adolescent is the negative relationship 
between level of ability at adolescence 
and gain in mental age score from ado- 
lescence to adulthood. We have found, 
for example, that the higher the 1941 
Stanford-Binet score, whether expressed 
as IQ or MA, the slightly lower the rate 
of increase (MA increase/CA increase ) 
to 1956 for the group of 45 subjects who 
were 14 to 16 years of age in 1941. (For 
this analysis, subjects less than 14 years 


of age in 1941 were eliminated in‘ 


order to minimize the operation of 
differential rates of mental growth in 
adolescence.) The correlations express- 
ing this (r = —.152 and —.212 for IQ 
and MA, respectively) are not signifi- 
cantly different from zero. Comparable 
correlations for males and females con- 
sidered separately are consistent with 
the findings on sex differences discussed 
earlier in that the females showed a sig- 
nificant negative relationship, whereas 
the males did not. The correlations be- 
tween 1941 IQs and rate of increase to 
1956 for 24 males and 21 females were 
.058 and —.385, respectively. 

Thus, although the adult scores on 
intelligence tests can be predicted with 
some accuracy from the score one ob- 
tains as an adolescent (as indicated by 
the correlations in Table 1), we have 
not isolated factors which permit us to 
predict the amount of mental age gain. 
The fact that adult intelligence can be 
predicted from adolescent intelligence 
with such a high degree of accuracy 
despite the lack of relation between 


adolescent intelligence and amount of 


gain to adulthood is, of course, due to 
the fact that the amount of gain at 
these levels represents such a relatively 
small proportion of the total “amount” 
of intelligence. We can anticipate that 
there will be an increase in mental age 
from adolescence to adulthood, but we 
cannot predict which subjects will gain 
most. We do know that amount of gain 
is not dependent upon level of initial 
mental age, on the extent of education, 
or on the level of ancestral intelligence 
(Bradway & Robinson, 1961), in con- 
trast to mental growth in the earlier 
years where these factors are important 
(Bradway, 1945a). Our only positive 
finding in this area is the one pointed 
out earlier, which is that adolescent girls 
with high IQs can be expected to in- 
crease less in mental age than will girls 
who test lower, or than males who test 
at any level. 


Prediction of Adult Intelligence 


The next questions which arise are 
those of how early can adult intelligence 
be predicted, and what are the best 
measures for predicting it. Or, what are 
the origins of adult verbal and non- 
verbal abilities? 

An analysis of the predictive value 
of Stanford-Binet preschool items to 
adult WAIS scores can, help answer 
these questions. At the time of the 1941 
study, the principal investigator devised 
four subscales from the preschool Form 
L and Form M Stanford-Binets and 
computed four subscale quotients for 
each subject (Bradway, 1945b). These 
were labeled “verbal quotient,” “non- 
verbal quotient,” “memory quotient,” 
and “number concept quotient.” Be- 
cause the Stanford-Binet at the adoles- 
cent and adult levels is an almost wholly 
verbal instrument, it was not possible in 
that earlier study to determine whether 
or not one maintains his relative superi- 
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ority and inferiority in these categories 
over any length of time. The admin- 
istration of the Wechsler Adult Intelli- 
gence Scale in the present study, how- 
ever, allows us to make such “profile” 
comparisons. Corresponding subscale in- 
dices were derived from the WAIS by 
using Comprehension, Similarities, In- 
formation, and Vocabulary for compari- 
son with the 1931 verbal quotient; the 
Performance scale for comparison with 
the nonverbal quotient; Digit Span 
with the memory quotient; and Arith- 
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¢ TABLE 8 


CorRELATION OF PREDICTIVE PRESCHOOL ITEMs OF ForMs L AND M OF THE 
STANFORD-BINET wiTH WAIS VERBAL QUOTIENTS 


metic with the number concept quo- 
tient. Inasmuch as the WAIS results 
are in standard scores, all that was nec- 
essary to obtain indices for these four 
WAIS categories which were compara- 
ble with each other was to divide the 
verbal total by four and the perform- 
ance total by five. The mean of these 
four indices was then obtain for each 
subject, and his score for each category 
was expressed as a deviation from his 
own mean. A similar method was used 
for the 1931 scores, except that each of 


M II % 6* Obeying Simple Commands g3eee 2% Vv 
L III 2° Picture Vocabulary 77 2% Vv 
L III 4° Picture Memories ggeee 22 M 
M III 3 Objects by Use 66* 2% Vv 
M III 6 Repeating Three Digits 67* 24% M 
LIII % 2 Picture Vocabulary 84** 4 Vv 
Objects by Use 2% Vv 
L III % 6* Comprehension I 86** 4 Vv 
M III % 6 Comprehension I 74** 2% Vv 
L IV Picture Vocabulary 4 
L IV 2° Objects from Memory 79** 4 M 
L IV 4° Pictorial Identification 80** 4 Vv 
L IV A‘ Memory for Sentences I 80** + M 
M IV 6 Memory for Sentences I -70* 2% M 
LIV% 6 Opposite Analogies I .73** 4 Vv 
M IV% 1 Animal Pictures .64* 4 NV 
M 5 Materials .74%* 4 Vv 
LV 5 Memory for Sentences II .64* 4 M 
M V 2 Number Concept of Three Rated 4 NC 
M V 3° Pictorial Similarities and Differences .61* 5Y Vv 
L VI 4 Number Concepts 71 5% NC 
L VI 5 Pictorial Likenesses and Differences 72000 5% Vv 
M VI 2 Copying Bead Chain so” 5Ya NV 
M VI 3° Differences 60* 5% Vv 
M VII 4° Three Digits Reversed 62* 5% M 
*There were 17 subjects in the 2'/-year-old group; 16 in the 4-year-old; 17 in the 4'/-year-old; and 21 in 
the 5'-year-old. The other groups (2-year-olds, 3-year-olds, 3'/:-year-olds, and 5-year-olds) not large 


enough for valid calculations. , 
> These refer to the Bradway subscales described previously (Bradway, 1945b). 
© Indicates used in 1960 L-M Revision of the Stanford-Binet. 

* Significant beyond .05 level. 
** Significant beyond .02 level. 


*** Significant beyond .01 level. 


Groups by 
Location Item years of age * Type> 


INTELLIGENCE aT ADULTHOOD 11 


the four subscale scores had to be con- 
verted into standard scores before the 
individual profiles of ‘deviation scores 
could be figured. 

The stability of pattern over a period 
of 25 years was tested by the correlation 
between the deviation scores calculated 
as each individual’s deviation from his 
own mean for the 1931 subscales, and 
the deviation scores also calculated as 


each individual’s deviation from his own 
mean for the 1956 WAIS. Three of 
these four correlations are significant in 
the positive direction. For the verbal 
component, the Pearsonian r is .236 sig- 
nificant at the .02 level; for the non- 
verbal component, .191 significant at 
the .05 level; and for the memory com- 
ponent, .301 significant at the .01 level. 
For the number concept component, 


TABLE 9 


CorreELaTIONs OF Prepictive PrescHoot Items or Forms L M oF THE 
STANForD-BInET with WAIS PerForMANCE QUOTIENTS 


Item 


Groups by 
Yer. years of age* 


Picture Vocabulary 
Comprehension 

Picture Vocabulary 
Objects from Memory 
Pictorial Identification 
Discrimination of Forms 
Opposite Analogies I 
Pictorial Identification 
Memory for Sentences I 
Materials 

Pictorial Identification 
Animal Pictures 
Repeating Four Digits 
Materials 

Copying a Square 
Counting Four Objects 
Number Concept of Three 
Comprehension II 
Vocabulary 

Bead Chain from Memory 


Mutilated Pictures 


Pictorial Likenesses and Differences 


Copying Bead Chain 
Counting 13 Pennies 
Opposite Analogies I 
Picture Absurdities I 
Three Digits Reversed 


.90*** 
87*** 
* 
.70* 
-70* 
.68* 
.63* 
.70* 
.69* 
~.62* 
.86*** 
.68* 
58* 
61* 
.60* 


w 


RRS 


5% 
5Y 


® There were 17 subjects in the 2'/:-year-old group, 16 in the 4-year-old, 17 in the 4'/2-year-old, and 21 
54-year-old. The other groups (2-year-olds, 3-year-olds, 3'/2-year-olds, and 5-year-olds) were not 


for valid calculations. 


LF 


> These refer to the Bradway subscales described previously (Bradway, 1945b). 
© Indicates used in 1960 L-M Revision of the Stanford-Binet. 


* Significant beyond .05 level. 
** Significant beyond .02 level. 
*** Significant beyond .01 level. 


| 
Location 

M III 2° 

‘ L III% 6° 
LIvi¢ 
L IV 2° 
L IV 4° 
L IV 5° 
M IV 3° 
M IV 4° 
M IV 6 
LIV% 4 
LIVYA 
M IV% 1 
M IV% 3 
M IV% 5° 
LV 4° 
LV6 
M V 2 
MV5 

L VI 1 || 
2 L VI 2 

L VI 3° 
L VI 5 
M VI 2 
M VI 5 
M VI 6 

L VII 1° 
M VII 4 
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(figured on 79 subjects rather than 110 
because for 31 subjects no such ratio 
could be computed at the preschool 
ages) the correlation was only .089, not 
significant, suggesting that relative 
strength or weakness in this ability is not 
stable over a 25-year period. Inasmuch, 
however, as one’s score on this scale con- 
tributes to his deviation scores on the 
other three, further analysis is necessary 
before drawing such a conclusion. 

To study the predictive value of pre- 
school items in more detail, biserial 
correlations of each Stanford-Binet pre- 
school item to adult WAIS verbal quo- 
tient and adult WAIS performance quo- 
tient were calculated. This analysis is 
summarized in Tables 8 and 9 in which 
are listed those items whose biserial r’s 
were significant beyond the .05 level for 
the indicated age groups. 

The figures in the column headed 
“Groups by years of age” indicate the 
age group for which the corresponding 
biserial r was figured. Since there was 
no way of combining the age groups, 
biserial r’s were figured for each 1931 
age group for which an item was perti- 
nent, which was defined for purposes of 
this analysis as each age group in which 
the number of subjects was 15 or more 
and for which the percent passing the 
item was between 25 and 75. The dis- 
tribution by type of the total 79 items 
for which biserial r’s at one or more age 
levels were computed were as follows: 
37 verbal, 24 nonverbal, \12 memory, 
and 6 number concept. The type desig- 
nation follows that previously described 
by Bradway (1945b). Comparison of 
the frequency of each type found to 
have significant predictive value at one 
or more age levels and the total number 
of such items studied shows the follow- 
ing: of 37 verbal items, 14 (38%) pre- 
dicted WAIS verbal IQ and 14 (38%) 
predicted WAIS performance IQ; of the 
24 nonverbal items, 2 (8%) predicted 
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WAIS verbal IQ and 5 (21%) pre- 
dicted WAIS performance IQ; of the 
12 memory items, 7 (59%) predicted 
WAIS verbal IQ and 5 (41%) pre- 
dicted WAIS performance IQ; of the 
6 number concept items, 2 (33%) pre- 
dicted WAIS verbal IQ and 3 (50%) 
predicted WAIS performance IQ. This 
kind of analysis is only suggestive be- 
cause the number of items is small, but 
it supplements in more detail the find- 
ings for the subscales reported above. 
In summary: verbal items predict both 
verbal and performance adult ability 
better than do nonverbal items; “each 
kind of memory item (memory for digits 
forward and reversed, for sentences, for 
objects, for pictures, and for bead chain) 
predicts both WAIS verbal and per- 
formance ability; number concept items 
are inconsistent in their predictive value 
—the only significant negative correla- 
tion obtained being for a number con- 
cept item. 

When one compares these results with 
those for the subscale deviation scores 
reported above, similarities are found. 
Both analyses suggest the greater value 
of verbal and memory items over non- 
verbal items in predicting adult abilities, 
and the unreliability of number concept 
items at the preschool level as predictors 
of adult abilities. 


Measurement of Intelligence 


After reviewing these data we are in 
a better position to approach the prob- 
lems of what index or indices to use in 
expressing adult intelligence and how 
best to predict it. If the 1937 Stanford- 
Binet is used to measure adult intelli- 
gence, a use for which it was not specifi- 
cally designed, it is apparent that a 
correctional factor of some kind must be 
applied to IQs obtained according to the 
published instructions. Merrill kindly 
applied the deviation scores provided in 
the 1960 Revision (Terman & Merrill, 


- 
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1960) to our data. The resulting intel- 
ligence quotients are 109.3 in 1931, 
109.4 in 1941, and 119.4 in 1956. These 
findings of identity between preschool 
and adolescence and a 10 point rise to 
adulthood indicate that the correction 
inherent in the 1960 deviation scores 
does not solve the problem. For our re- 
search purposes we rejected the use of 
a multiplicative factor because this 
would have changed the standard devi- 
ations, and used instead a subtractive 
factor which, since the standard devi- 
ations were nearly identical, was suffi- 
cient to equate the adult set of scores 
with the two previous ones. This, al- 
though a satisfactory solution for re- 
search purposes, may not be the optimal 
solution from the point of view of the 
clinician. Perhaps the possibility of re- 
vised deviation tables, accounting for 
greater increase into adulthood than do 
those published with the 1960 Revision, 
should be explored. 

This problem is not encountered in 
measuring adult intelligence with the 
WAIS which was specifically designed 
for the measurement of adult intelli- 
gence. Moreover, our data demonstrate 
that there are different kinds of ability 
which have a degree of constancy 
throughout life. The structure of the 
WAIS is a recognition of this. 

When new tests are constructed, those 
for adults would do well to provide valid 
measurements of different kinds of abili- 
ties, because the practicing clinician 
needs such information to evaluate se- 
lective impairment of intellectual func- 
tioning and for vocational guidance and 
occupational placement. In contrast, a 
preschool test heavily weighted with 
verbal items should be a more valid 
predictor of adult abilities, both verbal 
and nonverbal, than one utilizing many 
performance-type items. Moreover, the 
former would be consistent with the 
usual purpose for which preschool tests 


are used in that the prediction of school 
performance puts a heavy demand on 
verbal abilities. 

The present data demonstrate that 
the defining of adult intelligence is com- 
plex. It is not expressed by a single 
index in terms of abilities, in terms of 
one’s place relative to others of the same 
age group, or of one’s location on a 
scale of development and decline. As 
Cameron and Magaret (1951, p. 158) 
have said in alluding to the use of tests 
in defining behavior, “Performance on 
test items alone can no more define 
biosocial immaturity than can a refrac- 
tive index define the complex process of 


seeing 
SUMMARY 


A group of 111 subjects who had been 
tested with the Stanford-Binet (S-B) at 
the preschool and adolescent levels were 
administered the S-B and WAIS at 
adulthood (25 years after initial test- 
ing). Correlations of preschool IQs 
with adult S-B and full WAIS IQs are 
59 and .64. Correlations of adolescent 
IQs with adult S-B and full WAIS IQs 
are .85 and .80. The S-B IQ shows a 
mean increase of 11 points from adoles- 
cence to adulthood, which corresponds 
to a mental age gain of 20 months be- 
yond what would be expected if mental 
growth ceases at 16 years. The data 
were analyzed in an attempt to deter- 
mine the point at which mental growth, 
as measured by these tests, ceases, but 
it could not be determined. 

The males show significantly more 
IQ gain from adolescence to adulthood 
than do the females (p < .01). Fac- 
tors associated with amount of gain were 
not isolated except that girls with high 
IQs at adolescence increase less than do 
girls who initially test lower or than 
males who test at any level. There is no 
evidence that educational attainment is 
related to amount of gain. 


li 
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Analysis of increases in percent pass- 
ing S-B items from adolescence to adult- 
hood indicates that intellectual growth 
after adolescence is greater in abstract 
reasoning and vocabulary than in rote 
memory and practical reasoning. 

Analysis of the value of S-B preschool 
items in predicting adult WAIS scores 
shows some stability of pattern of indi- 
vidual differences in verbal versus non- 
verbal versus memory superiority over 
the 25 years. It also shows the greater 
value of verbal and memory items over 
nonverbal items in predicting both 
verbal and performance adult IQs, and 
the unreliability of number concept 
items as predictors of adult abilities. 

The data are interpreted as dem- 
onstrating that adult intelligence is 
complex. and cannot be meaningfully 
expressed by a single index. 
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This’ report on 2 studies of factors involved in learning French is 
based on 23 tests administered to 208 students in college French, and 
on 22 tests administered to 202 additional students a year later. The 
factors extracted and rotated in each study included: Verbal, Rea- 
soning, Speed of Articulation, Pitch Discrimination, Timbre Discrimi- 
nation, Interest, and Biographic. Multiple correlation test selection 
analyses resulted in (a) R = .65, using 6 tests to predict Coopera- 
tive French Test scores; (b) R = .41, using 5 tests to predict aural 
comprehension; and (c) R = .41, using 5 tests to predict speaking 
proficiency. Verbal IQ and Interest (motivation) appear to be the 
most important factors in college foreign language learning; Reason- 


ing, Word Fluency, and Pitch Discrimination also contribute. 


It is popularly believed that foreign 
languages are analogous to mathematics 
or music in that a special talent is re- 
quired to learn any of them. This belief 
appears fallacious and even harmful in 
that it may adversely affect the achieve- 
ment of those who think that they do 
not possess this special talent. The in- 
vestigation of which this paper is a part 
seeks to reduce the so-called “talent for 
languages” to a set of well-defined, 
measurable components. Tests of the 
components will then be used to predict 
probable success in foreign language 
courses. The attempt to isolate and de- 
scribe as many as possible of the com- 
ponents affecting foreign language 
learning should lead to improved under- 
standing of the learning processes in- 
volved. Presumably, the tests developed 
for predictive purposes will also be 
found useful in diagnosing the sorts of 
difficulties encountered by poor lan- 
guage learners. 

As Carroll’s (1960) thorough review 
of the literature of foreign language 


1Since June 1960, the research reported 
herein has been performed pursuant to a 
contract with the Office of Education, United 
States Department of Health, Education, and 
Welfare. 


prognosis indicates, considerable success 
has been achieved in predicting results 
of intensive language courses, such as 
those given in the military services. 
However, attempts to predict achieve- 
ment in high school and college courses 
have generally been less successful. 
There appear to be influences present in 
the typical school course which do not 
enter into intensive courses, and which 
need to be taken into account to attain 
high predictive validity. Prognostic tests 
composed entirely of intellectual tasks 
probably owe their rather low validity 
to their failure to include important 
nonintellectual variables. Motivation 
factors almost certainly affect achieve- 
ment, and personality may also be im- 
portant. Another kind of prognostic 
test, the work sample, sometimes is a 
good predictive device, but sheds no 
light on the language learning process. 
The studies reported in this paper at- 
tempt to deal with a number of fairly 
precise intellectual and motivational 
factors. Personality factors, not includ- 
ed here, will be introduced in subse- 
quent research. The previous research 
most closely related to that reported 
here is the work of Carroll (1958). 
The two studies which are the subject 
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of this paper were conducted at UCLA 
in the spring semesters of 1958 and 
1959, respectively. In both cases, the 
subjects were students in second semes- 
ter French courses, 208 in the first 
study, and 202 in the second. The two 
samples appear closely comparable, aid 
quite typical of a moderately good 
group of American undergraduates. 
Their average age was 19 years; most 
were graduates of California public high 
schools who gained admission to college 
by achieving a B average; most were 
taking French to fulfill degree require- 
ments. 

The data consist of scores on a num- 
ber of predictor variables and several 
criteria. In the light of the current 
shift toward teaching the spoken lan- 
guage, it was of particular interest to 
attempt differential prediction of tra- 
ditional (grammar-reading) achieve- 
ment on the one hand, and oral-aural 
achievement on the other. 

All tests were administered to groups, 
under good testing conditions during 
regular class hours. Tests requiring 
speaking or listening were administered 
in the language laboratory. Tests simi- 
lar in nature (e.g., Reading Aloud I and 
II) were given at least a week apart. 
The predictor tests were given early in 
the semester, the criterion tests at the 
end. 

The two studies will be reported in 
the following order: 

Study I—Variables, factor analysis, 
multiple correlation analysis 

Study II—Variables, factor analysis, 
multiple correlation analysis 


Results 


Stupy I 
Variables 
The data for the first study consisted 
of scores on 21 test variables and two 
criteria. The test variables were chosen 
to represent factors which, on the basis 


of teaching experience and linguistic 


theory, were hypothesized to be related 
to success in learning a foreign language. 
The hypothesized factors were associa- 
tive memory, analytic reasoning, reason- 
ing by analogy, physical dexterity in 
articulation, ability to change linguistic 
set, auditory discrimination, interest in 
foreign languages, and several others. 
Tests were either found or constructed 
to represent the hypothesized factors in 
as “pure” a manner as possible. 

It appeared desirable to try out a 
large number of such predictor varia- 
bles. As there were more tests than 
could be given in a single semester, the 
first study omitted several factors of 
potential importance, such as auditory 
discrimination and language interest, 
which then appeared in the second 
study. 

The 23 variables which provided the 
data for the first study are as follows: 


1. Modern Language Aptitude Test 
(MLAT), Part I1I—Spelling Clues (Carroll 
& Sapon, 1955). The subject chooses which 
of five words has the same meaning as the 
word represented in abbreviated form. Sam- 
ple: kataklzm—(a) mountain lion, (6) dis- 
aster, (c) sheep, (d) chemical reagent, (e) 
population. Highly speeded: 50 items, 8 
minutes. 

2. MLAT, Part I—Number Learning. By 
tape recording, the subject is taught a simple 
artificial system of number expression utiliz- 
ing nonsense syllables. He is then asked to 
write down the arabic numeral equivalents 
of a list of 2- and 3-digit numbers in the 
artificial system spoken at a fairly rapid pace 
on the tape. This version utilizes the digits 
0, 1, 2, 3, 4. Fifteen items, total time 10 
minutes. 

3. MLAT, Part IV—Words in Sentences. 
This test was designed to measure the ability 
to understand the function of words and 
phrases in sentence structure, without calling 
on knowledge of grammatical terminology. 
Each item consists of a “key sentence” with 
a word or phrase capitalized, followed by one 
or more sentences with other words or 
phrases underlined and numbered. The sub- 
ject is directed to pick the word or phrase 
in the second sentence (or sentence-group) 
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which does the same thing in that sentence 
as the capitalized word does in the key 
sentence. 
Sample: 


He spoke very well of you. 
Suddenly the music became quite loud. 
1 2 3 + 


The test contains 45 items. The time allowed 
is 15 minutes. 

4. MLAT, Part V—Paired Associates. 
The subject studies a list of 24 “Kurdish-Eng- 
lish” vocabulary equivalents for 2 minutes; in 
the next 2 minutes he practices recalling the 
English meanings, and he then has 4 minutes 
to complete from memory a multiple-choice 
test of the presented vocabulary (24 items). 

5. Letter Series (adapted from Guilford). 
A series of seyen letters is given, to which 
the subject must add the next two. Sample: 


6. Reading Aloud I (speed). The subject 
is given time to study a meaningful para- 
graph of English prose, then is asked ‘to re- 
cord his reading of it, “speaking as quickly 
as possible while still remaining intelligible.” 
Score is number of words read in 30 seconds. 

7. Same test (accuracy). Number of 
errors made in 6. 

8. Reading Aloud II (speed). The sub- 
ject is given time to study a meaningless 
paragraph. made up of English words put 
together at random. He then records his 
reading of it “speaking as quickly as possible 
while still remaining intelligible.” Score is 
number of words read in 30 seconds. 

9. Same test (accuracy). Number of er- 
rors made in 8. 

10. Paraphrase. The subject is to give as 
many paraphrases as possible for a given 
phrase. Sample: for to pie, the subjects 
might give “to kick the bucket,” “to cash in 
one’s chips,” étc. Score is number of para- 
phrases given in 4 minutes. 

11. Rhymes, The subject is to give as 
many words as possible that rhyme with 
four given words (LAKE, CLOUD, SO, GRASS). 
Score is number of rhymes given in 2 minutes. 

12. Synonyms. The subject is to give as 
many synonyms as possible for four given 
words. Sample: for co, the subject might 
give “ride,” “drive,” “fly,” “travel,” etc. 
Score is number of synonyms given in 4 
minutes. 

13. Phonetic Perception. The subject 
hears three sounds and must tell which one 
is different from the other two. The test 


uses distinctions which are nonphonemic in 
English (e.g., “r” vs. “rr”). Twenty items, 
5 minutes. 

14. Linguistic Analysis I. The subject is 
given a list of 22 foreign forms (adapted 
from Kabardian) together with their English 
equivalents. By consulting the given forms, 
he is to deduce how other things are said 
in this language. Ten multiple-choice items, 
12 minutes. 

15. Linguistic Analysis II. The subject is 
given a list of 19 forms in a foreign language 
(adapted from Kabardian) together with 
their English equivalents. By consulting the 
given forms, he is to deduce the meanings of 
a number of other foreign forms given to 
him. Ten multiple-choice items, 12 minutes. 

16. Verbal Comprehension (Guilford- 
Zimmerman). A test of English vocabulary 
knowledge. Forty items, 6 minutes. 

17. Age. The subject gives his age at last 
birthday and is placed in one of five cate- 
gories: under 18, 18-20, 20-22, 22-25, over 
25. 

18. Sex. Female or male, scored zero or 
one. 

19. Bilingualism. To be rated as “bi- 
lingual” a subject has to answer either or 
both of the following questions affirmatively: 
Is a language other than English spoken reg- 
ularly in your home? Is your native lan- 
guage other than English? Scored zero for 
mono-, one for bilingualism. 

20. High School Language Grades. An 
average of grades in high school language 
courses. 

21. High School Math-Science Grades. 
An average of grades in math and science 
courses in high school. 

22. (Criterion) French II Final Grades. 
Letter grade assigned by teacher at end of 
second semester of college French. (A, B, C, 
DF = 43,2, 1,96). 

23. (Criterion) French Speaking Profi- 
ciency Test. A five-part recorded test of 
ability to speak French at end of second 
semester. Scored by native judges. 


Factor Analysis 


A matrix of zero-order Pearson cor- 
relations was computed from the scores 
of the 208 subjects on the 23 variables 
just described. These correlations, to- 
gether with the means and standard 
deviations of the variables, are shown 
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in Table A.2 From this matrix, eight 
centroid factors were extracted and then 
rotated, using Kaiser’s normal varimax 
criterion (Kaiser, 1958).° Table B pre- 
sents the rotated fagtor matrix. Load- 
ings of less than .30 were not considered 
significant. Descriptions of the eight 
factors follow: 


Factor A: Reasoning. This factor is 


made up of seven variables (loadings 
shown at right). 


2. Number Learning 
21. High School Math-Science 
Grades 
14. Linguistic Analysis I 
3. Words in Sentences 
15. Linguistic Analysis II 
5. Letter Series ; 
22. French II Grades (criterion) .34 


This factor resembles others variously 
called General Reasoning, Verbal Rea- 
soning, Induction, etc., in previous fac- 
tor analytic findings. It appears to 
include the ability to induce the orderly 
principle in a group of examples (e.g., 
Letter Series) , and to apply this princi- 
ple to a variety of new examples (e.g., 
Number Learning). 


Factor B: Word Fluency. The vari- 
ables with sizable loadings on this factor 
are: 


10. Paraphrase 65 
12. Synonyms .64 
11. Rhymes 41 


2Tables A, B, C, and D have been depos- 
ited with the American Documentation Insti- 
tute. Order Document No. 6943 from ADI 
Auxiliary Publications Project, Photoduplica- 
tion Service, Library of Congress; Washing- 
ton 25, D. C., remitting in advance $1.25 
for microfilm or $1.25 for photocopies. 
Make checks payable to: Chief, Photodupli- 
cation Service, Library of Congress. 

8 The factor analytic computations in Study 
I were performed on SWAC, an electronic 
‘computer located on the campus of UCLA 
and supported by the Office of Naval Re- 
search, 


The identification as Word Fluency 
requires some amplification. Word Flu- 
ency is usually defined as the ability to 
produce words which conform to cer- 
tain structural limitations, e.g., four- 
letter words of the types s — — E. In 
the present case, the limitations are not 
structural but semantic. Both kinds of 
tests entered into factors called Word 
Fluency by previous investigators (Car- 
roll, 1941; Thurstone, 1941). The fac- 
tor found here most nearly resembles 
Guilford and Christensen’s (1956) 
Eduction of Conceptual Correlates. The 
name Word Fluency has been retained 
because it is more familiar. 


Factor C: Biographic. This factor 


is made up of: 


. Sex—scoring code: 

feminine = 0, masculine =1  .64 
. High School Language 

Grades —.58 
. Age 52 
. Paired Associates —.34 
. Words in Sentences —.31 


This factor seems to reiterate the well- 
known fact that girls do better than boys 
in high school language courses. How- 
ever, at the college level, sex fails to 
correlate significantly with either cri- 
terion (—.02 and —.08, respectively) . 


Factor D: Achievement in French. 
This factor is made up of the two 
criteria: 

—.65 
—.57 


23. French Speaking Test 
22. French II Grades 


It seems to represent a unique portion 
of the variance in the criteria. It may 
be pointed out that the two criteria were 
arrived at in different ways, by different 


judges. 


Factor E: Speed of Articulation. 
Two variables have significant loadings: 


— 
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—.68 


8. Reading Aloud II (speed) 
6. Reading Aloud I (speed) 


The identification seems clear. 


Factor F: ? The variables included 
in this factor are: 


5. Letter Series —.42 
13. Phonetic Perception -.37 
19. Bilingualism 34 
15. Linguistic Analysis I —.$2 


The meaning of this factor is not 
clear, beyond the fact the bilinguals per- 
form poorly in the three other variables. 
No interpretation will be attempted, as 
these variables appear again in the next 
study. 


Factor G: Response Set. The two 
variables composing this factor are: 


9. Reading Aloud II (errors) —.48 
7. Reading Aloud I (errors) —.44 


This factor, reflecting the number of 
errors made while reading a passage at 
top speed, may be interpreted as Re- 
sponse Set, i.e., the tendency of some 
to avoid mistakes by working a little 
slower, while others work very rapidly 
even at the risk of making mistakes. 


Factor H: Verbal. Three variables 
make up this factor: 


16. Verbal Comprehension 59 
1. Spelling Clues 43 
11. Rhymes 37 


The chief loading being that of an 
English vocabulary test, this may be 
identified as ‘the Verbal or Verbal 
Knowledge factor. 

Summarizing the factors whose iden- 
tification appears clear, they are: Rea- 
soning, Word Fluency, Biographic, 
Achievement in French, Speed of Ar- 
ticulation, Response Set, and Verbal. 


Multiple Correlation Analysis 


A multiple correlation coefficient, R, 


was computed * for each of the two cri- 
teria, using as predictors the entire bat- 
tery of 21 tests. The results, together 
with the proportion of variance contrib- 
uted by each variable, are presented in 
Table 1, Columns A and C. 

Reduction was attempted in the size 
of the batteries. The three or four tests 
making the highest contributions were 
chosen as a basic battery. To these were 
added other tests, singly or several at a 
time, in many different combinations, 
and the resulting Rs computed. The 
batteries shown in Table 1, Columns B 
and D, are those which minimize the 
number of tests while maximizing the 
multiple correlation coefficient. 

For predicting French grades, the 
minimum battery consists of Number 
Learning (or Spelling Clues), Words in 
Sentences, Letter Series, Reading Aloud 
I, Paraphrase, Linguistic Analysis II, 
age, and high school math-science 
grades. This seven-test battery yields a 
multiple R of .43. The inclusion of 
Number Learning or Spelling Clues 
gives approximately the same results; 
the inclusion of both does not raise the 
R appreciably. 

For predicting Speaking Test scores, 
the minimum battery consists of Spell- 
ing Clues, Letter Series, Reading Aloud 
II, Verbal Comprehension, and Bilin- 
gualism. This five-test battery yields a 
multiple R of .42. 

In evaluating the multiple correlation 
coefficients, several factors which mili- 
tate against accurate prediction must be 
taken into account. The first of these 
is the unreliability of the teacher grades 
used as one of the criteria. If grades are 
assumed to have a reliability of, say, 


*This part of the analysis used the BIMD-6 
program supplied by the Biostatistics Lab- 
oratory, Department of Preventive Medicine, 
UCLA. The computations were performed 
on an IBM 709 computer, through the co- 
operation of the Western Data Processing 
Center, UCLA. 
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TABLE 


MULTIPLE CORRELATION ANALYSIS 


French Speaking Test 


A B Cc D 

Variable (21 tests) | (7 tests) (21 tests) (5 tests) 

1. Spelling Clues .033 .058 .058 
2. Number Learning .025 .036 002 
3. Words in Sentences .047 .063 | .007 
4. Paired Associates .002 .003 

5. Letter Series .008 .019 .024 
6. Reading Aloud I (speed) .021 .029 | .023 
7. Reading Aloud I (errors) .000 .003 

8. Reading Aloud II (speed) 002 010 027 
9. Reading Aloud II (errors) .014 .001 
10. Paraphrase .009 .012 001 
11. Rhymes .001 000 
12. Synonyms .000 .000 
13. Phonetic Perception .005 .008 
14. Linguistic Analysis I .000 .000 
15. Linguistic Analysis II .010 012 .004 

16. Verbal Comprehension 002 .036 044 
17. Age 012 012 .002 
18. Sex (feminine = 0, masculine = 1) 001 .001 

19. Bilingualism .022 .024 .028 023 
20. High School Language Grades .004 | 000 
008 | 01 


21. High School Math-Science Grades 


R= .478 R= 433 | R= .454 R= .418 


Note.—Proportion of variance contributed by each variable to the prediction of each criterion: A and C 


.70, then the correction for attenuation 
raises the multiple R from .43 to .52. 
The Speaking Test criterion might be 
similarly corrected, though there is some 
evidence to show that it has high relia- 
bility (Pimsleur, 1961). A second con- 
sideration is the fact that certain poten- 
tially important variables were not 
included. The use of additional variables 
and more reliable criteria are features of 
the second study. A third consideration 
is the restriction in range of ability 
among the examinees. The college pop- 
ulation is highly select; the second 
semester population of French students 
is even more so. This homogeneity 
makes accurate prediction very difficult. 


—using all tests, B and D--using the most economical battery. 


Strupy II 
Variables 


In Study II, a somewhat different set 
of variables was used. Those which had 
proven uninteresting in Study I were 
discarded. Others were added to tap 
additional factors, e.g., Numbers 9 
through 12, dealing with an auditory 
factor, and Numbers 13 and 14, treating 
interest or motivation. Despite their 
good results in the first study, the 
MLAT parts were dropped because 
they contain copyright material and so 
could not be used in developing a new 
battery. 

The last three variables are three 


4 
20 
| French II Grades | 
A 
i! 
ae 
ae 
oF 
; 
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criteria, all new to this study. The 
Cooperative French Test was used as a 
measure of achievement in the reading 
and writing goals. Oral achievement 
was rated by a laboratory instructor who 
had listened to students and graded 
them in the lab once a week for a full 
semester. Achievement in understand- 
ing spoken French was measured by the 
Pictorial Auditory Comprehension Test, 
an objectively scored test. 


The variables for Study II are these: 


1. Verbal Comprehension (Guilford- 
Zimmerman). See Study I for description. 
2. Linguistic Analysis I. See Study I. 

3. Ship Destination Test (Christensen- 
Guilford). Find the distance from ship to 
shore considering the influence of several 
variables. Thirty-three items, 15 minutes. 

4. Grammatical Transformations. The 
subject is given a sample transformation (c.g., 
“They are good. Books are interesting.” 
— “Good books are interesting.”) In a new 
item, he is to select from among four choices 
the one which represents a transformation 
similar to the sample (e.g., “It is noisy. 
Telephones are annoying.” —* “Noisy tele- 
phones are annoying.”) Twenty items, 9 
minutes. 

5. Paraphrase. See Study I. 

6. Rhymes. See Study I. 

7. Reading Aloud I. See Study I. 

8. Reading Aloud II. See Study I. 

9. Phonetic Perception. See Study I. 

10. Chinese Pitch Perception. Subject 
is taught three Chinese words which differ 
only in pitch. These are then imbedded in 
Chinese sentences and subject must tell 
which he hears. Thirty items, 10 minutes. 

11. Seashore Pitch Test. Subject hears 
two tones, must tell whether the second is 
higher or lower than the first. Thirty-five 
items, 5 minutes. 

12. Seashore Timbre Test. Subject hears 
two chords, must tell whether the second is 
the same or different than the first. Thirty- 
five items, 5 minutes. 

13. Interest I. Twenty items relating to 
interest in language. Subject answers each 
on a five-point scale. 

14. Interest II. The subject is asked to 
rate on a five-point scale the extent of his 
interest in studying the foreign language he 
is now studying. 

15. Bilingualism. See Study I. 


16. Age. See Study I. 

17. Sex. See Study I. 

18. High School Language Grades. See 
Study I 

19. High School Math-Science Grades. 
See Study I. 

20. (Criterion) Cooperative French Test, 
Advanced Forms Q and R. A standardized 
test of achievement in reading, grammar, and 
vocabulary. Total scores were used. 

21. (Criterion) Lab Grade. An estimate 
of speaking ability given by laboratory in- 
structor on basis of listening to student all 
semester, plus a final oral test. Grades from 
Oto 

22. (Criterion) Pictorial Auditory Com- 
prehension Test. An objectively scored test 
of French listening comprehension. Subject 
must select from among four pictures the 
one which correctly illustrates the sentence 
he has just heard. Tape recorded, 50 items, 
20 minutes. 


Factor Analysis 


From the scores of 202 subjects on the 
22 variables a matrix of zero-order cor- 
relations was computed. It is presented, 
together with the means and standard 
deviations of the variables, in Table C. 
From this, eight factors were extracted 
and rotated.® The rotated factor matrix 
is presented in Table D. 

The analysis yielded eight factors, all 
of which could be identified, though 
with varying degrees of assurance. 


Factor A: Achievement in French 
(Verbal). The first factor is composed 
of seven variables (loadings at right) . 


Cooperative French Test 
(criterion ) 

Lab Oral Grade (criterion) 
Aural Test (criterion) 
Verbal Comprehension 
High School Language 
Grades 

Interest I 

Sex 


This factor is ambiguous. The first three 
variables are the three criteria, and 


5 This part of the analysis used the BIMD- 
17 program, on the 709 computer. 


21 
i 
20. 
73 
21. 55 
22. 52 
1. 47 
18. 
44 
13. 35 
17. 31 
: 


22 P. Pimsieur, R. P. Stockwe.t, anp A. L. Comrey 


appear therefore to compose a factor 
specific to achievement in learning 
French. Here, they are associated how- 
ever with a verbal component (Tests | 
and 18), and a component of motiva- 
tion or interest (Test 13). 


Factor B: Speed of Articulation. 
This factor is made up of: 


8. Reading Aloud II 77 
7. Reading Aloud I at 


The identification is clear. However, 
these variables did not correlate highly 
with the criteria, as they did in the first 
study. For example, Reading Aloud I 
correlated .20 (significant beyond the 
.01 level) with the first criterion in the 
previous study, but only .04 (nonsignifi- 
cant) with the first criterion in the 
present study. 


Factor C: Reasoning. The compo- 
nents of this factor are: 


19. High School Math-Science 


Grades 51 
3. Ship Destination Test 46 
2. Linguistic Analysis I 37 
4. Grammatical 

Transformations 32 


This factor seems easily identified as 
Reasoning, or General Reasoning. The 
first two tests (19 and 3) are nonverbal 
in nature, while the other two (2 and 4) 
involve linguistic tasks. This factor 
shows a close relation between verbal 
and nonverbal reasoning. 


Factor D: Biographic. This factor 


consists of: 


16. Age 56 
1. Verbal Comprehension 39 
17. Sex 37 
18. High School Language 
Grades 


It seems appropriate to consider this a 
biographic factor, though its interpre- 
tation is not clear. It is of interest that 


sex, which did not correlate significantly 
with the criteria in the first study, did 
do so in the second. 


Factor E: Pitch Discrimination. The 
variables which form this factor are: 


11. Seashore Pitch Test 50 
10. Chinese Pitch Test 44 
4. Grammatical 

Transformations 37 


The identification as pitch discrimina- 
tion seems correct. It should be noted 
that the two pitch tests (11 and 10) are 
quite different in nature, the former 
involving pure tones and the latter in- 
volving language. These two pitch tests 
correlate significantly with the first and 
third criteria, but not with the second 
one. The presence of Test 4 on this 
factor is not readily explainable. 


Factor F: Word Fluency. This fac- 
tor is made up of: 


5. Paraphrase 50 
6. Rhymes 41 
15. Bilingualism —.38 


The identification is clear. The presence 
of Test 15 merely means that foreign 
subjects have less word fluency in Eng- 
lish than do Americans. 


Factor G: Interest in Languages. 
The two variables composing this factor 
are: 

14. Interest II 70 
13. Interest I 67 


The identification presents no difficulty. 
Both these variables correlate signifi- 
cantly with all three criteria. 


Factor H: Timbre Discrimination. 
This factor consists of: 


9. Phonetic Perception 36 
12. Seashore Timbre Test ae 


The first of these variables (9) involves 
actual language sounds, while the other 


an 


| 
| 
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(12) involves nonlanguage tones. 
Though the loadings are low here, it is 
nevertheless intriguing that pitch and 
timbre appear as two distinct factors. 
These two variables correlate signifi- 
cantly with the third (aural) criterion, 
but not with the other two. 


Multiple Correlation Analysis 


The test selection procedure differs 
somewhat from that used in the first 
study. Here, a stepwise regression pro- 
gram was used in conjunction with a 
multiple correlation program, the for- 
mer to find the best one-test battery, 
best two-test battery, etc., up to 9 or 10 
tests, and the latter to determine the 
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multiple R ard the contributions to 
variance of _4 test in each of the best 
batteries.® 

Results of the analysis are presented 
in Table 2. As can be seen in Column A 
of Table 2, the criterion of Cooperative 
French Test scores can be predicted to 
the extent of R = .673 when all 19 tests 
are used. The number of tests may be 
reduced considerably, without much loss 
in predictive accuracy. Column B shows 
the best six-test battery for predicting 
this criterion. This is a modest battery 
which can be administered in a 50- 
minute class period; it yielded an R of 


®The programs referred to are BIMD-6 
and BIMD-9. 


TABLE 2 


Stupy II: 


MULTIPLE CoRRELATION ANALYSIS 


Criterion 20: 


Cooperative French Test 


| 
Criterion 21: | 


Lab (oral) Grades 


Criterion 22: 
Auditory Comprehension 


Variable (19 tests) 


B 
(6 tests) 


D E F 


Cc 
(19 tests) (5 tests) (19 tests) (5 tests) 


Verbal Comprehension | 


Linguistic Analysis 

Ship Destination 

Grammatical 


017 
.000 


.004 
.000 
.010 
.002 
001 
001 
019 
.000 
004 
.123 
.020 
.007 
.006 
022 
019 


Transformations 
Paraphrase 
Rhymes 
Reading Aloud I 
Reading Aloud II 
Phonetic Perception 
Chinese Pitch 
Seashore Pitch 
Seashore Timbre 
Interest I 
Interest II 
Bilingualism 
Age 
Sex 
High School Language 
High School 


Math-Science .003 


193) 


024) 
125] 


.037| 
.024| 


075 
.030 
000 


075 
.030 


021 
001 


021 


002 
000 
015 
006 
.018 
.002 


001 
.004 
.003 
.000 
001 
.008 
O11 
.002 
.009 
.032 
001 
.000 
.000 
.003 
.005 


000 

000 
040 
009 
003 
008 
013 
048 


052 
.009 | 


| 016 005 


R=673 R=.652\R=457 R=.410|R=.436 


Note.- Proportion of variance contributed by each variable to the prediction of each of 3 criteria: A,C,E— 
using all tests; B,D,F—using the most economical battery. 


3. 
4. | 
5. | 
6. 
ia 7. | | 
8. 
9, 
10. 015 
11. | 
12. 013 
13. | 031 
14. 
15. 
| 16. 
17. 
18. 
19, 
R= .405 
+ 


24 P. R. P. StocKwett, anp A, L. Comrey 


.652 (estimated shrinkage, R = .646).” 
Two improvements in the second study 
as compared with the first probably 
account for the more satisfactory result. 
They are the use of a more reliable cri- 
terion, i.e., a standardized test in place 
of teacher grades, and the inclusion of 
new variables which turned out to be 
quite important. 

The other two criteria can also be 
predicted by a small battery of tests, as 
may be seen in Columns D and F of 
Table 2. .However, these multiple Rs 
are considerably lower than those for 
the Cooperative French Test, probably 
due to the lower reliability of the other 
two criteria. 


RESULTS 
Prognosis 


By far the best predictive accuracy 
was obtained in the prediction of Co- 
operative French Test scores, in Study 
II. A multiple correlation coefficient of 
R = .652 was arrived at by a six-test 
battery that can be administered in less 
than an hour. While this battery has 
not yet been validated on other samples 
(such work is under way), it appears to 
be as good a device for predicting suc- 
cess in foreign language learning in 
college as is now available. The regres- 
sion equation for predicting Cooperative 
French Test scores is: 


Y’ = 47.37 + 47X, + 18X10 + 


As for the other two criteria, speaking 
ability and listening comprehension, the 
multiple correlation coefficient obtained 
for each of them was approximately .41, 
with a battery of five tests. The regres- 
sion equations associated with the pre- 
diction of these two criteria in Study II 
are, respectively : 


7Shrinkage estimated by McNemar’s For- 
mula 75. See McNemar (1955, p. 186). 


Y’ = 3.25 + .04X, + 31X44 + 64X15 
+ 98X18 37X19 [2] 
16X42 09X13 [3] 
Diagnosis 


The manner in which prediction of 
Cooperative French Test scores was 
achieved merits attention. The tests 
contributing to this prediction are 
Verbal Comprehension, Interest I and 
II, Chinese Pitch, Sex, and High School 
Language Grades; i.e., they represent 
factors of verbal intelligence, motiva- 
tion, pitch discrimination, and certain 
biographic elements. While the predic- 
tive accuracy they afford is satisfying, 
it does not come about in the way one 
might wish. It had been hoped that 
foreign language achievement could be 
predicted on the basis of intellectual 
factors, such as the ability to discrimi- 
nate sounds, to induce grammatical 
principles, and so on. Instead, it ap- 
pears from these studies that the two 
biggest factors in such achievement are 
the very general ones of verbal IQ and 
motivation. This finding says that as 
far as language study in college is con- 
cerned, anyone will do well who is 
intelligent and wants to learn, regard- 
less of such concerns as having “a good 
ear,” “a good memory,” and “good 
reasoning powers.” 

Nonetheless, it is of interest to exam- 
ine the relative importance of the factors 
which contribute to the prediction of 
each criterion. 

Though the first criterion (the gram- 
mar-reading goal) was measured in 
quite different ways in the two studies, 
this fact will be ignored for the moment, 
to permit comparison of the two sets 
of findings. These are the tests which 
contributed 1% or more to prediction 
of the first criterion: 
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. Words in Sentences .047 

. Spelling Clues .033 
Number Learning .025 
Bilingualism .022 

. Reading Aloud I .021 
Reading Aloud II 
(errors) 014 
Age .012 
Linguistic Analysis II .010 


Verbal Comprehension .193 
Interest I .123 
Sex .022 
Interest II .020 
. High School Language .019 
. Chinese Pitch .019 
Linguistic Analysis I .017 
Rhymes .010 


In Study I, three of the tests (3, 2, 
15) are associated with the Reasoning 
factor. Test 1 is associated with the 
Verbal factor. Test 6 is associated with 
Speed of Articulation; Test 9 with Re- 
sponse Set; Test 17 with the Biographic 
factor. 

The factorial findings in Study IT dif- 
fer partly from those of Study I, since 
different tests are involved. In Study II, 
Tests 1 and 18 are associated with a 
Verbal factor; Tests 13 and 14 with an 
Interest (motivation) factor; Test 17 
with a Biographic factor; Test 10 with 
a Pitch Discrimination factor; Test 2 
with a Reasoning factor; Test 6 with a 
Word Fluency factor. The Verbal, Rea- 
soning, Word Fluency, and Biographic 
elements were found in both studies. 
The interesting Speed of Articulation 
finding of the first study was not con- 
firmed by the second. Interest and Pitch 
Discrimination are new additions in the 
second. 

These findings permit the tentative 
conclusion that achievement of the tra- 
ditional (grammar, reading, writing) 
objectives of a college French course 
involve primarily verbal intelligence and 
motivation on the student’s part, but 
may also involve his ability to reason 


both analytically and by analogy, and 
his ability to think up words quickly. 
In order to examine the two sets of 
findings with regard to oral (speaking) 
achievement, the difference between the 
two measures of the criterion will again 
be ignored. There follows a summary 
of the tests which contribute 1% or 
more to the prediction of this criterion: 


Study I 
1. Spelling Clues .058 
16. Verbal Comprehension .036 
19. Bilingualism .028 
6. Reading Aloud I .023 
5. Letter Series .019 
8. Reading Aloud II .010 
Study II 


18. High School Language .048 
13. Interest I .040 
1. Verbal Comprehension 021 
8. Reading Aloud II 018 
19. High School Math-Science .016 
6. Rhymes 015 
17. Sex 013 


Represented in the findings of Study I 
are the Verbal factor (Tests | and 16), 
the Speed of Articulation factor (6 and 
8), and the Reasoning factor (5). The 
factors represented in Study II are 
Verbal (Tests 1 and 18), Interest in 
Language (13), Speed of Articulation 
(8), Reasoning (19), Word Fluency 
(6), and Biographic (1, 17, 18). 

These findings suggest that in order to 
do well in learning to speak French in 
college the student must possess, above 
all, verbal intelligence and high motiva- 
tion, and that in addition he may be 
helped by his analytic reasoning ability, 
his ability to articulate words rapidly, 
and his ability to think them up. 

As for the third criterion, listening 
comprehension, it is predicted by: 


Study II 
1. Verbai Comprehension 075 
13. Interest I .032 
2. Linguistic Analysis I .030 
10. Chinese Pitch 011 
12. Seashore Timbre .009 


Study I 
19 
6 
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17 
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1 
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The factors involved here are, again, 
verbal intelligence and motivation, plus 
reasoning, pitch discrimination, and 
timbre discrimination. 

It is concluded from the studies thus 
far completed (a) that achievement in 
a traditional (grammar-reading) lan- 
guage course may be predicted with 
reasonable validity by a set of tests, each 
of which taps only one rather precise 
characteristic of the learner; (6) that 
nonintellectual characteristics, notably 
motivation, must be included as well as 
intellectual ones; (c) that oral and aural 
achievement are less subject to satisfac- 
tory prediction at the present time, 
probably due to the lack of adequate 
criterion tests for achievement in these 
skills; (d) that although better criterion 
tests will improve prediction somewhat, 
substantial improvement probably de- 
mands the inclusion of entirely new fac- 
tors as predictors; (¢) that among such 
new factors, the personality of the stu- 
dent and the characteristics of the 
teacher are those which appear most 
promising and are most in need of 
research attention. 
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TRAINING ADULTS TO JUDGE CHILDREN’S 
SOCIAL ACCEPTANCE 


HELEN R. MARSHALL 
Drexel Institute of Technology 


To determine whether specific training improves the accuracy of adult 
judgments of children’s social acceptance, 290 college students en- 
rolled in a course requiring observation of a preschool group were 
divided into a control group, a group trained in factual knowledge, 
and a group exposed to a standard as well as to factual knowledge. 
Accuracy of judgment was tested 6 weeks after training. Results 
suggested that reduction as well as improvement in accuracy may 
result from training. Accuracy decreased when information as to 
earlier sociometric choices was provided, and increased after factual 
knowledge training. IQ was related to accuracy of judgment after 
training limited to factual knowledge, while personality characteristics 


influenced judgments only when no training was given. 


Investigations have shown that most 
teachers are grossly inaccurate judges 
of the social acceptance of children in 
their classes, but have not revealed 
either bases for easy identification of the 
few accurate teachers, or how teacher 
judgments could be improved. 

The hypothesis that specific training 
improves accuracy seems as applicable 
to judgments of social acceptance as to 
other learning. Training about factors 
influencing children’s acceptance by 
peers has not been included in the prep- 
aration of most teachers. A first purpose 
of this investigation was to test this 
application. 

The study was planned to test the 
specific hypothesis that more adults will 
reach a minimum accuracy level (agree- 
ment with children’s choices beyond the 
.05 level of significance) if they are 
given training about the social behavior 
relating to social acceptance by pre- 
school peers, and are exposed to earlier 
sociometric choices of the children to 
be judged. The factual demonstration 
planned for the second phase of this 
hypothesis derived from a suggestion by 
Gronlund (1950) that teachers trained 
in use of sociometric techniques might 
judge more accurately. 


A second purpose of the investigation 
was to study the effect of training con- 
ditions on relations between accuracy 
of judgments and both IQ and certain 
personality characperistics of the judges. 
This purpose required maximizing the 
range of scores in training groups. 


METHOD 
Subjects 

Initiation of this ‘ investigation depended 
upon the validity of an assumption that col- 
lege students enrolled in a course requiring 
weekly observation of a nursery school group 
might be as accurate in their judgments as 
the teachers studied in past research. If 
half had better than chance agreement with 
children’s sociometric choices, they would 
be comparable to teachers. This conjecture 
was supported (Marshall, 1958) when tested 
on the untrained control group of this study. 

The 290 subjects were about two-thirds 
of the enrollment in a child development 
course of the University of Kentucky in seven 
of the eight semesters from fall 1956, 
through spring 1960. Students were dis- 
carded as subjects if they were absent at test 
or training sessions, had not taken the uni- 
versity entrance examination, or had a score 
of seven or more on the Lie scale admin- 


1The data of this report were collected 
and partly analyzed while the author was a 
faculty member of the University of Ken- 
tucky. 
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istered with the Manifest Anxiety scale (Tay- 
lor, 1953). Difficulties with photographic 
arrangements needed for the children’s socio- 
metric test prevented training students in the 
fall 1957 semester. 

Students comprising a year’s enrollment in 
the course had a wider range of scores than 
was found in any semester, section, or pro- 
jected subdivision. For this reason, students 
were assigned to training groups on the basis 
of date of enrollment in the course, as is 
shown in Table 1. A change in entrance 
examination scores was the only difference 
between training groups in tested personal 
characteristics. Mean percentile rank was 
35 in 1956-57 on the Kentucky Classification 
Battery, but it was 50 in 1959-60. The lower 
limit of the range increased from 1 to 25. 
The change took place during the 2 years 
of comprehensive training. The upper limit 
was 98 or 99 in all groups. 

A change in nursery school enrollment, 
shown also in Table 1, meant that students 
split their 2 weekly hours of observation be- 
tween preschool groups during the last 2 
years, and had less time to observe each 
child. 


Training 


The two trained groups were given the 
same introduction and description of nursery 
school behavior relating to preschool social 
acceptance. Training was conducted by the 
investigator in one lecture period during the 
fifth or sixth week of the semester. Students 
were informed that they were subjects in a 
study about the effect of training on judg- 
ments. Research findings about the accuracy 
of teacher judgments were summarized. 
Knowledge of the criterion for their accu- 
racy was given by a description of the method 
of obtaining children’s choices, the picture 
sociometric test (McCandless & Marshall, 
1957). 

Description of social behavior relating to 
choice as a playmate by preschool peers re- 
quired 30 minutes. Content was based on 
research done by the investigator, and em- 
phasized the following relations. 

1. Sociometric choices depend more di- 
rectly on the extent of two types of observa- 
ble social participation than on actual play- 
mates. A child is more often chosen by other 
children in the group when the child spends 
more time talking and acting out the roles 
of dramatic play with them, and the child 
interacts with a larger number of children 
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in a given time. These two behaviors tend 
to increase with age, but age per se does not 
influence choices. If a girl and a boy appear 
equal in these behaviors, the girl is more 
often chosen as a playmate by peers. 

2. Acceptance in a preschool group is not 
influenced by (a) the extent of aggression 
and hostility shown to peers, and (b) how 
often the child talks to others as himself, 
rather than as an imaginary thing or person. 
An exception to a is that peer choices of 
boys increase as boys more often express 
hostility in acting out dramatic play roles. 

3. A child who is more dependent on the 
teacher during play than others of the same 
age will be less often chosen as a playmate 
by peers. 

4. Resemblance between sociometric test 
choices of preschool children decreases as the 
time between tests increases from 1-6 weeks. 
Choices on the first test are not good pre- 
dictors of choices made 6 wecks later. 

Behavior examples were drawn from re- 
search observations and from observation of 
the current nursery school group. 

No other training was given to the limited 
training group. The remaining time was 
spent discussing development of social be- 
havior, a topic considered at other class 
meetings for the control and comprehensive 
training groups. 

The comprehensive training group received 
the additional training of a demonstration 
of sociometric choices of the preschool chil- 
dren they were observing and later would 
judge. Children had been tested during the 
week preceding training. Preferred play- 
mates of each child were listed on the black- 
board before the session, and remained there 
during the 50-minute period. An oral sum- 
mary of the choices was presented after the 
introduction and before the description of 
social behavior. The fact that these choices 
were a useless basis for judgment at the end 
of the semester was strongly emphasized. 


Testing 

All subjects judged the social acceptance 
of the children twice. The first test period 
occurred in the week preceding training, and 
the second occurred 6 weeks after training, 
or after 11 or 12 weeks of observation. 

Students were asked to list the three chil- 
dren they thought each child would select as 
best friends on the child’s sociometric test. 
Their tests were compared with the socio- 
metric tests given to the children during the 
same week. 
The probability of the agreement between 
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each student’s judgment and each child’s 
choices, irrespective of order of choice, was 
determined for the specific preschool group, 
and converted into the appropriate chi 
square. If the sum of the chi squares was 
large enough for significance at the .05 level, 
the student was classified as judging at an 
accuracy level beyond that of chance. 

Tests of personality characteristics admin- 
istered at either or both test periods to all 
groups are listed in Table 2. 


RESULTS 


The results shown in Table 1 indi- 
cate that accuracy of adult judgments 
of children’s social acceptance can be 
both improved and reduced by specific 
training. 

Training limited to a description of 
social behavior relating to acceptance 
by peers was followed by attainment of 
beyond chance accuracy by all students. 
This was twice the proportion judging 
at this level of accuracy in the untrained 
control group. 

When this training was supplemented 
by exposure to past sociometric choices 
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of the children to be judged, the pro- 
portion of students judging at the .05 
level of accuracy decreased to half that 
of students given no training, and to 
one-fourth that of students given the 
limited training. 

According to this evidence, the appli- 
cation of the specific training hypothesis 
to adult judgments of social acceptance 
depends upon the content of specific 
training. Additionally, the hypothesis 
needs to be modified to include the 
possibility of effects in either direction. 

Insight into the reasons for these dif- 
ferences is provided by the correlations 
between percentage accuracy of student 
judgments and personal characteristics 
scores shown in Table 2. Entrance ex- 
amination scores correlated with per- 
centage accuracy only within the lim- 
ited training group. The apparent rela- 
tion in the case of the control group was 
indicated by partial r’s to be due to the 
influence of manifest anxiety scores (de- 
scribed further on p. 210, Marshall, 
1958). A relationship between IQ and 


Taste 1 


COMPARISON OF TRAINING GROUPS ON DETERMINATIONS OF ACCURACY OF 
JUDGMENT oF PRESCHOOL CHILDREN’s SOCIAL ACCEPTANCE 


1956-57 
(N = 131) 


Determination of accuracy 


| No training 


| Comprehensive training 


j Limited training 
Total Spring 1958; 1958-59 1959-60 
(N 112) | (N= 50) | (N = 62) (N 47) 


Percent of subjects judging at 
.05 level of accuracy ** 
Percent of subjects judging at 
.01 level of accuracy ** 
Mean percentage agreement of 
student and child choices 
Number of groups judged 
Number of children judged 
In younger group 
In older group 


42 
15 


2 
18 and 20) 
12 and 13) 
6 and 7 


29 and 33 
15 and 17 
14 and 16 


* Percentage for small N of older group adjusted to that of a group of 12 children. 
** All differences between three training groups were significant at the .001 level by x? test. 
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TaBLe 2 


PropuctT-MoMENT CORRELATIONS BETWEEN PERSONAL CHARACTERISTICS SCORES AND 
PERCENTAGE AGREEMENT AT THE END OF THE SEMESTER OF STUDENT AND CHILDREN’S 
Cuorces In THREE TRAINING Groups 


No training 


Personal characteristics scales (N = 131) 


Comprehensive training 


Total [Spring 1958} 1958-59 
(N = 112) | (N = 50) | (N = 62) 


College entrance examination 
Manifest Anxiety scale —.48 
Harsh Punitive Control scale of 
Parent Attitude Research 
Instrument‘ 
Early in semester 
At end of semester —.32* 


—-.19 .09 
—.02° .07 


13 ~15 


a> Difference between r* and 7» in the separate rows of the table significant at .05 level. 


¢Schaefer and Bell (1955). 
* Significant at .01 level. 


accuracy of judgments did not exist for 
judgments any group made prior to 
training. IQ influenced learning to 
judge social acceptance, then, only after 
training limited to knowledge of social 
behavior relating to social acceptance. 

Both types of training nullified the 
influence of other personality character- 
istics on accuracy of judgments at the 
end of the semester, according to correla- 
tions shown in Table 2. Negative corre- 
lations between personality test scores 
and percentage accuracy at the end of 
the semester were found in the group 
given no training, and in all three 
groups before training. 

Two possible explanations of the re- 
duction in accuracy obtained after the 
comprehensive training were explored 
through additional analyses. 

The possibility of excessive reliance on 
the sociometric choices presented during 
training was studied by determining the 
percentage agreement of students’ end 
of semester judgments and children’s 
early in semester choices. In the spring 
1958 group, agreement was 44%, and 


was higher (.001 level by ¢ test) than 
that shown in Table 1. In the next year 
of comprehensive training, agreement 
was 36%, and did not differ from that 
shown in Table 1. Fewer than 5% of 
the students in any group made judg- 
ments early in the semester that agreed 
beyond the .05 level with children’s 
early in semester choices. These data 
support the possibility that students re- 
lied unduly on children’s choices pre- 
sented in training. 

This possibility also is supported by 
the evidence in Table 1 that students 
given comprehensive training were less 
accurate in end of semester judgments 
in the year when they judged fewer 
children than in the year when they 
judged more children. 

The possibility that students in the 
comprehensive training group might not 
have used observation cues in forming 
judgments was studied through use of 
data collected for other purposes. The 
most frequent playmates of each child 
during the 4 weeks preceding the final 
sociometric tests were derived from ob- 
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servation records for the preschool 
groups judged by the control group and 
the spring 1958 comprehensive training 
group. Agreement at the .05 level of 
accuracy was attained by 38% of the 
comprehensive training group, and by 
809% of the control group. Clearly, the 
comprehensive training students relied 
less on observed behavior than students 
given no training. 


DiscussION 


Learning a social behavior (judg- 
ment of social acceptance of children) 
was shown to relate to IQ in one, but 
not both training conditions. The con- 
ditions required for influence of IQ 
appeared to be presentation to all sub- 
jects of a factual basis for judgment, 
and the absence of exposure to examples 
or a standard which may, in effect, pro- 
vide misinformation. A higher IQ did 
not facilitate learning prior to training, 
and it did not prevent the reduction in 
accuracy found to accompany exposure 
to a standard, ie., knowledge as to 
earlier sociometric choices made by the 
pupils under observation. 

Reduced accuracy of judgment was 
a consequence of the type of training 
that was used to “make situations real” 
to students. It is widely believed that 
students learn more when factual train- 
ing is supplemented by examples of real 
situations. Under the conditions em- 
ployed in this investigation, this supple- 
ment sufficed to eliminate both the 
facilitating effects of factual knowledge, 
and cues from prior experience, which 


presumably were used by students in the 
control group. 

Analyses supported two conjectures 
about concomitants of the reduced ac- 
curacy: undue reliance on the examples 
presented in training, and decreased use 
of observed behavior as a basis for 
judgment. Perhaps adults in a training 
situation hesitate to use their own judg- 
ment after another adult has pro- 
nounced judgment, or given a standard. 

It is concluded that training can im- 
prove the accuracy of teachers’ judg- 
ments of children’s social acceptance, 
but that further study is desirable to 
determine the types of training that will 
be most advantageous. 
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THE EFFECTS OF DISCRIMINATION PRETRAINING 
ON TEXTUAL BEHAVIOR’ 


CAROLYN K. STAATS, ARTHUR W. STAATS, anno RICHARD E. SCHUTZ 
Arizona State University 


The study compared 3 groups (12 each) of kindergarten children in 
learning textual responses. Group | had discrimination pretraining 
with the same words as those in the criterion task, Group 2 with the 
letters making up these words, and Group 3 no discrimination train- 
ing. The response analyzed was the number of correct anticipations 
in 10 trials of a 4-word task. Analysis of variance showed no differ- 
ence between groups, but a Duncan new multiple range test indicated 
a significant difference between Group | and Groups 2 and 3, but 
not between the latter. Thus there was positive transfer to a later 
task involving the same stimuli, but this did not seem due to acquisi- 
tion of an observing response to the components of the stimulus. 


Muehl (1960) has investigated the 
effects of different types of visual dis- 
crimination pretraining on the perform- 
ance of kindergarten children in learn- 
ing to read a vocabulary list. He found 
that children who received pretraining 
in matching the same words that ap- 
peared in a later vocabulary list learned 
to “read” the words significantly better 
than children who received similar pre- 
training with different words or with 
geometric forms. 

Muehl suggests that it was the re- 
sponse to single letters or details of let- 


1 The research reported in this paper was 
supported by the United States Office of 
Education, Cooperative Research Branch, 
under Contract No. 1048. A summary of 
this article was presented at the national 
meetings of the American Psychological Asso- 
ciation in New York City, September 1961. 
The authors wish to thank John Mabry and 
Donald V. Huard for help in collecting the 
data and Irwin Miller for aid in interpreting 
the statistical analysis. The authors also 
wish to express gratitude for the assistance 
of Roy Doyle and Carol Steers of the Arizona 
State University Campus Laboratory School, 
Lois Kline of the District Office of Tempe 
Elementary Schools, Frank Huston and 
Jacqueline Miller of Broadmor Elementary 
School, Augusta Carminati and Patricia 
Huddle of Wayne Ritter Elementary School, 
and Robert Curry of McKemey Junior High 
School in Tempe, and Lorenzo Rich of West 
Mesa Junior High School in Mesa. 


ters that appeared to account for his 
finding. He hypothesizes that “positive 
transfer to the learning task . . . was 
due to the acquisition, during pretrain- 
ing, of a set of observing responses to 
distinctive letters in the stimulus words.” 

The present study extends the stimu- 
lus pretraining research by comparing 
the effects of two different types of 
pretraining experiences. Prior to learn- 
ing the same vocabulary list, kindergar- 
ten children were exposed to one of 
three conditions: (a) discrimination 
pretraining with the same words as those 
appearing in the vocabulary list, (b) 
discrimination pretraining with the let- 
ters making up the words in the vocab- 
ulary list, and (c) no discrimination 
training. 

Based upon the hypothesis that if 
differences are established among simi- 
lar stimulus elements, then learning will 
be facilitated in a subsequent task using 
these same stix.wuli, it would be predicted 
that no significant difference in learning 
the vocabulary list would be found be- 
tween the group given visual discrimina- 
tion pretraining on the same words and 
the group receiving visual discrimina- 
tion pretraining on the letters in the 
words. Both these groups would be ex- 
pected to learn the vocabulary list 
faster than the group given no discrimi- 
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nation pretraining. On the other hand, 
if the requisite condition for facilitation 
of learning is discrimination pretrain- 
ing on the same stimuli, it would be 
predicted that the group given training 
on the same words would learn the 
vocabulary list faster than either of the 
other two groups. 

Another line of theory and research 
also contributes to the present study. 
Skinner (1957) introduced the term 
“textual response” to refer to an oper- 
ant vocal response under the control of 
nonauditory verbal stimulus, i.c., print- 
ed symbols. It is suggested that this 
term should replace the phrase “read- 
ing aloud” because the complicated 
connotations of the verb “to read” are 
often misleading. Questions of “com- 
prehension” or “understanding” or 
“meaning” frequently become spurious- 
ly intertwined with research aimed at 
understanding the variables involved in 
learning to make the appropriate vocal 
response to the printed verbal stimulus. 
Although a full analysis of reading must 
include the principles of classical con- 
ditioning and the interaction of classical 
and operant principles in the develop- 
ment of word meaning (Staats, 1961; 
Staats & Staats, 1957), the use of the 
term texting concerns only the operant 
conditioning of a vocal response under 
the control of a visual verbal stimulus. 
The present study utilized these princi- 
ples in two ways: discrimination pre- 
training was programed (the discrimi- 
nation progressing in difficulty through 
the training with little opportunity for 
failures) ; and reinforcement was made 
contingent upon the emission of correct 
vocal operants in both discrimination 
and texting training. 


METHOD 
The procedure was composed of three 


parts: familiarization training which was 
uniform for all subjects, discrimination pre- 


training which differed for each group, and 
criterion texting which was the same for all 
subjects. 


Subjects 


The subjects were 36 children from two 
kindergartens in Tempe, Arizona. Shortly 
prior to the experiment the Columbia Men- 
tal Maturity Scale was administered to all 
subjects. The children were then matched on 
MA and assigned to one of the three pre- 
training groups. There were 12 children in 
each group. Table 1 shows the mean ages 
and MAs in each group. In all phases sub- 
jects worked individually with one of two 
adult male experimenters. 


Familiarization T raining 


The following procedure was used to ac- 
quaint the subjects with the token reinforce- 
ment system and to train them in the re- 
sponses required for the discrimination task. 
To establish the tokens as reinforcers, the 
subject was given four or five token plastic 
discs and allowed to choose and buy a toy 
(plastic trinket), This was done twice for 
each subject. The training for the discrimi- 
nation task involved the following: Subjects 
were shown 10 cards consecutively, each 
containing three stimulus components (geo- 
metric figures, drawings of common objects, 
or combinations of letters printed upside 
down), two of which were the same and 
one different. The first five cards were sim- 
ply 5 X 8 replications of the first five items 
of the Columbia Mental Maturity Scale with 
which the children were already familiar 
because of prior testing. The subject was 
instructed. “Point to the one that doesn’t 
belong.” If the subject responded correctly, 


TABLE 


Means anv SDs or MENTAL AND 
CHRONOLOGICAL AGE IN MONTHS 


Group I | Group II | Group III 


M | sp| M SD 


| 

| 

Mental age (65.9 7.07/65.8 5.29165.4 4.90 
Chronological | 


67.0 2.64/64.7 1.7366.9 3.32 
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he was given a token, while if the response 
was incorrect or if the subject failed to 
respond in 5 seconds, the experimenter with- 
held the token reinforcer and presented the 
next card. At the end of the series, the 
tokens were once again exchanged for toys. 


Discrimination Pretraining 


The two different sets of stimuli used in 
the pretraining phase each consisted of 48 
additional cards of the same type of task as 
that used in the familiarization training. 
Reinforcement in the form of tokens, later 
exchanged for toys, was again made con- 
tingent upon the correct response. 

For Group I the discriminative stimuli 
consisted of words printed in lower-case type 
which were later used in the texting task. 
Twenty-four cards were made up of com- 
binations of the four-letter words: door, bell, 
fish, kite. One of these four appeared twice, 
another appeared once on the card, and the 
subject’s task was to “point to the one that 
doesn’t belong.” Every word was paired with 
each of the other three in this series from 
one to three times. The remaining 24 cards 
each contained one of the same four-letter 
words paired once with other four-letter 
words not included in the texting task. Of 
these 24, eight discriminations involved words 
with all four letters differing, eight with 
three letter differences, and eight with two 
letter differences. The combined 48 cards 
were then arranged progressively as to diffi- 
culty of the discrimination, e.g., fish and door 
appeared on a card early in the program, 
while fish and film were paired on Card 47. 
The position of the correct alternative on the 
card was varied across the series of 48 cards 
to prevent a position preference. 

For Group II the 12 lower case letters 
b, d, e, f, h, i, k, l, 0, 7, s, and t, which 
comprise the words door, bell, fish, and kite, 
were presented individually rather than the 
words themselves. Along with each single 
letter another letter, randomly selected from 
the same list of 12 letters, appeared twice. 
Each of the 12 letters in the list appeared as 
a correct alternative on four occasions, ex- 
cept for e which occurred five times, and k 
which was presented three times. These 
cards were then arranged progressively as 
to difficulty of discrimination, e.g., Card 1 
was k k o, while Card 42 was ¢ o e. For 
the series of 48 cards the location of a cor- 
rect letter was varied so as to avoid a posi- 
tion preference. The subject’s task was 


again to “point to the one that doesn’t 
belong.” 

In both these groups, tokens were ex- 
changed for toys subsequent to Trials 8, 16, 
32, and 48. 

Group III received no discrimination 
training other than that implicit in the fa- 
miliarization training. 


Texting Task 


Immediately following the pretraining dis- 
crimination task, the same texting task was 
administered to all subjects. This criterion 
texting consisted of 12 presentations of each 
of the four words presented to Group I in 
the discrimination training (door, bell, fish, 
kite). These words were organized into six 
blocks, each block consisting of two presenta- 
tions of each of the four words; the order of 
the words within each block was random- 
ized. Each block was then divided into two 
trials of four words each, This yielded 12 
trials in all. 

Responses on the first trial (Cards 1-4) 
were pointing to the word as the experi- 
menter said the word, and for the second 
trial (Cards 5-8) the subject was to point 
to the word and repeat the word aloud (an 
“echoic” response). Since these two trials 
permitted no variability among subjects, the 
first block (Cards 1-8) is not included in the 
analysis. 

The final 10 trials (or five blocks) consti- 
tuted the criterion task. The subject was 
instructed by the experimenter to “say the 
word before I say it,” constituting a paired- 
associate method of presentation. The ex- 
perimenter presented the stimulus card, and 
then waited approximately 2 seconds for 
the subject to say the word. Correct re- 
sponses were reinforced as before, and in- 
correct responses were prompted but not 
reinforced. Tokens were exchanged for 
trinkets at the end of Trials 7 and 12, The 
entire experimental procedure was conducted 
in a small room close to the subject’s own 
classroom. 


RESULTS 


Learning curves depicting the 
number of correct anticipations occur- 
ring in the texting task for each of the 
pretraining groups are presented in 
Figure 1. A Bartlett’s test (Lindquist, 
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MEAN NUMBER OF CORRECT TEXTUAL RESPONSES 
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-—-—~ Grp. I (same words) 
Grp. II (same letters) 
— Grp, III (no disc, training) 


3h 5-6 


7-8 


BLOCKS OF TWO TRIALS 


Fic 1. The effect of type of discrimination pretraining on cofrect textual responses in 
learning the criterion task. (Eight responses were possible in each block of two trials.) 


1953) showed that the variance in the 
number of correct responses in the three 
groups was homogeneous. A summary 
of the analysis of variance (Lindquist, 
1953, Type I) for these data is given in 
Table 2. The F of 6.77 (p < .01) for 
Trials shows that significant learning 
occurred in the course of the texting 
training over the three groups. The F 
of 1.42 for Groups indicates that the 
type of discrimination pretraining did 
not significantly affect texting perform- 
ance. 

Edwards (1960, p. 136) points out, 
however, that “in making multiple com- 
parisons among treatment means, it is 
not necessary that the treatment mean 
square of the analysis of variance be 


significant.” He suggests that the choice 
of multiple comparison method should 
be guided by questions of experimental 


TABLE 2 


ANALYSIS OF VARIANCE OF CORRECT 
Textuat 


Source df 


Between subjects 35 
Groups (B) 2 
Error (b) 33 

Within subjects 144 
Trials (A) 4 
AXB 8 
Error (w) 132 


*p> .20. 
01. 
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interest. According to this rationale, 
and because of the discrepancy of the 
results of the analysis of variance with 
Muchl’s findings, it was considered ap- 
propriate to further compare the means 
of the pretraining groups with the Dun- 
can new multiple range test. This test 
indicated that there were significant dif- 
ferences (p < .05) between the mean 
of Group I and the means of Groups II 
and III. The difference between the 
means of Groups II and III was not sig- 
nificant. Inspection of Figure 1 also 
indicates that the difference between 
Group I and the other groups was evi- 
dent by the first block included in the 
analysis. The mean number of correct 
responses for Group I was 3.25 in the 
first block, but the mean of the first 
block in each of the other two groups 
was 1.83. 

Correlations were also obtained 
among the MA scores on the Columbia 
Mental Maturity Scale, the perform- 
ance on the discrimination task, and 


performance on the texting task. None 
of the three correlation coefficients was 
significant. 


DISCUSSION 


The results tend to corroborate the 
findings of Muehl and other investiga- 
tors (Kurtz, 1955; Spiker, 1956) that 
stimulus discrimination pretraining re- 
sults in positive transfer to a later task 
when the same stimuli are presented in 
that task. The interpretation that these 
results are due to acquisition of an 
observing response to the distinctive let- 
ters making up the words was not sup- 
ported since no significant difference 
was found between the group receiving 
pretraining on letters making up the 
words and the group receiving no pre- 
training at all. 

It would seem, then, that the word 
functioned as a unique stimulus in the 


discrimination training. Whatever the 
nature of the observing response, it 
was made to the entire word, a complex 
unitary stimulus. 

However, the results cannot be inter- 
preted as indicating that alphabetical 
pretraining in general has little or no 
effect in enhancing later texting per- 
formance. The subjects used in this 
experiment had not learned the letter 
names. Subjects were deliberately select- 
ed from a population which had not 
had “alphabet training” in order to iso- 
late the effect of simple discrimination 
pretraining, and to insure that the re- 
sponse of naming would not mediate 
the acquisition of textual responses. It 
may be, however, that texting pre- 
training on alphabetical units of words, 
including the development of some pho- 
netic responses to these units would 
prove the most efficacious type of pre- 
training in the applied situation. Thus, 
while the results question the relevance 
of pure discrimination pretraining on 
alphabet components of words in facili- 
tating later texting behavior, it may be 
that texting training on these units 
would prove valuable for transfer to the 
whole word. Further research relating 
texting of letter units to the later texting 
of entire words thus would appear to 
be fruitful. 

Another reason for questioning the 
efficacy of pure discrimination pretrain- 
ing for the later texting behavior is the 
wide variability in the texting perform- 
ance of subjects in the same group 
shown in Table 2. Since these variances 
were homogeneous, the size of the MS 
for between subjects in the same group 
may be interpreted as indicating the 
large differences among _ individuals 
were maintained in spite of constant 
experimental treatment. Thus, even 
though the results of Group I were, 
overall, superior to the other groups, 
large differences in the criterion texting 
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are still attributable to other unknown 
variables. Even the use of programed 
discrimination training did not suffice 
to bring the children to a common start- 
ing level. 

Finally, the lack of a significant cor- 
relation between discrimination and 
texting behavior indicates that better 
discrimination performers were not bet- 
ter learners of texting. This indicates 
that the same behaviors were not in- 
volved in the two tasks and that the 
acquisition of texting does not depend 
solely on the previous acquisition of 
observing responses. 

The lack of significant relationship 
between the pretest performance, i.e., 
the Columbia Mental Maturity Scale 
and the other two variables, also sug- 
gests that different variables are in- 
volved in performance of these tasks. 
The use of these types of tests for pre- 
dicting early reading behavior thus 
seems questionable. 
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SOME CHARACTERISTICS RELATED TO SOCIAL 
ISOLATION OF SECOND GRADE CHILDREN’ 


HARRIET H. COMMOSS? 
Teachers’ College, Columbia University 


Some 20 children scoring in the highest quarter of their classes on a 
sociometric test were compared with 20 children in the lowest quarter 
with respect to the following characteristics: learning of sex role, cer- 
tainty in interpersonal relationships, ability to communicate verbally, 
and eye-hand coordination. Positive relationships between social 
status and the stated characteristics were hypothesized. Each child 
copied a short sentence and was presented with the Driscoll Playkit 
and asked to complete 10 stories. Analysis of the data failed to sup- 
port the hypothesis of a positive relationship between social accept- 
ance and learning of own sex role but reliably supported the hypotheses 


related to the other characteristics. 


Harry Stack Sullivan (1953), in de- 
veloping his theory, laid emphasis on 
the importance of the early school years 
and the effect of social isolation at that 
period. He considered this period to be 
the actual time for becoming social and 
consequently believed that anything 
which interferes with peer relationships 
then may be doubly handicapping, first 
in terms of the original faulty learning 
which results in a greater or lesser de- 
gree of social inadequacy, and secondly 
through the resultant lack of opportu- 
nity for corrective or new learning. 

He believed that certain areas of 
inadequacy are usually associated with 
social isolation. Four of these areas 
were selected for study, and the follow- 
ing hypotheses were formulated: 

Hypothesis 1: Socially isolated chil- 
dren make slower progress than accept- 
ed children in personifying themselves 
as members of their own sex. 

Hypothesis 2: Socially isolated chil- 
dren are more uncertain as to reactions 
of others toward them and the outcomes 
of situations than are accepted children. 


1 This article was taken from a report with 
the same title submitted in partial fulfillment 
of the requirements for the degree of Doctor 
of Education, September 1, 1960. 

2 At present: School Psychologist, Great 
Neck, New York. 


Hypothesis 3: Socially isolated chil- 
dren tend to be more restricted in free- 
dom of communication than accepted 
children. 

Hypothesis 4: Socially isolated chil- 
dren progress more slowly in the devel- 
opment of eye-hand coordination than 
accepted children. 


METHOD 
Subjects 


In order to test the postulated relation- 
ships, two groups of second grade children 
were selected. They were chosen by means 
of a sociometric questionnaire from the mem- 
bers of 10 classes in five schools in a small 
New England city. Each child was asked to 
choose three others for each of three pur- 
poses: to sit beside, to play with at recess, 
to invite home after school. The responses 
to the questionnaire were weighted in line 
with the procedure described by Northway 
(1940). First choices received a weight of 
five, second choices of three, and third 
choices of two. The choices received by 
each child were then added together, and 
from the distribution of scores so obtained, 
two groups of children were selected for 
further consideration. Those in the top 
quarter of their own class distributions were 
considered to represent children highly ac- 
ceptable to their peers and are referred to 
henceforth as accepted children. Position in 
the lowest quarter was held to indicate some 
degree of social isolation, and children whose 
scores fell in this portion of the distribution 
are termed isolated children. 
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In the final selection of 20 children from 
each of the above groups, an effort was made 
to match the groups as nearly as possible in 
socioeconomic status and in intelligence. No 
child was included whose family received a 
rating lower than five (semiskilled worker) 
on the Edwards (1938) scale of socioeco- 
nomic grouping, and the IQs of all subjects 
as measured by the Pintner-Cunningham test, 
were between 90 and 120. The average IQ 
of the accepted children was 104.0, while 
that of the isolated children was 105.9 (r = 
—.18). 

Each child was presented with the Driscoll 
Playkit and 10 incomplete stories were read 
to him. The Playkit is an instrument devel- 
oped to facilitate the use of doll play in 
studying children. It consists of a small 
wooden suitcase containing furniture and 
partitions needed to set up a six-room doll 
house. A doll family of five is a standard 
part of the equipment. The kit is described 
in detail by Walsh (1956) together with 
directions for presentation of material and 
recording of data. 

The stories to which the children were 
asked to respond briefly described some situ- 
ation which was likely to be within their 
usual experience such as the following: “The 
child has just done something which the par- 
ents said not to do. What do you suppose 
happens next?” They were invited to an- 
swer both in words and through play with 
the dolls. The responses were recorded on 
tape and transcribed verbatim. 

A sample of each subject’s manuscript 
writing was obtained by asking him to copy 
the following sentence: “Betty is a little 
girl.” 


Anal ysis of Data 


The stories were analyzed in the following 
ways: proportion of responses referring to 
the children dolls which attributed action, 
thinking, or feeling to the child doll of the 
same sex as the child responding; ability or 
inability to respond with definite conse- 
quences to the story situations presented 
(scores for each story of 0, 1, or 2 deter- 
mined with the assistance of judges); and 
number of words spoken per minute. The 
writing samples were rated as “satisfactory” 
or “poor” by seven primary grade teachers. 


RESULTS 


It was found that no significant dif- 
ference existed in the relative frequency 
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with which children in the experimen- 
tal and control groups referred to the 
children dolls of their own sexes. Al- 
though the results shown in Table 1 are 
in the direction hypothesized, they failed 
to reach the .05 level of significance 
when evaluated by the median test for 
two samples. 

The socially isolated children were 
distinctly less willing than the accepted 
to commit themselves as to the outcomes 
of situations or the reactions of char- 
acters in their stories. The mean scores 


TABLE ! 


PRoporTION OF Responses REFERRING TO 
or Same Sex as CHILD 
RESPONDING 


Number of scores 


Above Selow 
Social status median median 
Accepted 
Boys 6 4 
Girls 5 5 
Both sexes | 11 9 
Isolated 
Boys 7 3 
Girls 2 8 
Both sexes 9 11 
TABLE 2 


Cur_pren’s Scores as DETERMINED BY 
ConseQueNnces DescriBep IN STORIES 


| 


Social status | Mean scores 
Accepted 
Boys 13.6 
Girls 14.1 
Both sexes | 13.85* 
Isolated 
Boys 11.6 
Girls 11.6 
Both sexes 11.6* 


*The difference between these means is significant 
at the .01 level. 
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on these variables for both groups are 
shown in Table 2. The difference be- 
tween means is significant (t = 2.68, 
df = 38, p < .01). 

The accepted children proved to be 
more fluent than the isolated children 
in responding to the stimuli presented. 
When the data shown in Table 3 were 
evaluated by the ¢ test, the difference 
between groups was found to be signifi- 
cant (t = 1.85, df = 38, p < .05). 


TABLE 3 


Rate or TALKING IN RESPONSE TO 
INCOMPLETE STORIES 


Mean number of words 
Social status per minute 


Accepted 


Boys 

Girls 

Both sexes 
Isolated 

Boys 

Girls 

Both sexes 


71.6 
88.4 
80.0* 


54.8 
70.7 
62.8* 


*The difference between these means is significant 
at the .05 level. 


TABLE 4 


Ratincs oF HANDWRITING AS DETERMINED 
BY AGREEMENT AMONG Five Out 
or SeveN JUDGES 


The data shown in Table 4 lend sup- 
port to the hypothesized relationship be- 
tween sociometric rating and eye-hand 
coordination as shown in handwriting 


(x? = 6.96, df = 2, p < .05). 


DiIscussION 


Since the data of this study failed to 
support the hypothesis that socially iso- 
lated children make slower progress in 
learning their appropriate sex roles than 
children who are accepted, a question 
arises as to the adequacy of the experi- 
mental measure. Inspection of Table 1, 
however, shows that the results, insofar 
as difference between the sexes is con- 
cerned, are in line with results of other 
studies such as those of Brown (1957) 
and Gray (1957). The boys as a total 
group gave evidence of a higher de- 
gree of sex identification than the girls 
x? = 3.6, df = 1, = 3.8). 

As a further check, the sociometric 
choices were statistically evaluated. 
Here, as Table 5 shows, there appeared 
not only a difference between sexes but 
also a significant difference between the 
two groups of boys (x* = 8.1, df = 1, 


TABLE 5 


SociometTric CHorces In RELATION 
To Sex CHOSEN 


Number of samples rated 


No 
Social status Satisfactory Poor agreement 


Accepted 
Boys 
Girls 
Both sexes 
Isolated 
Boys 
Girls 
Both sexes 


Number of children choosing 


Opposite Own sex 
Social status sex only 


Accepted 
Boys 10* 
Girls 5 
Both sexes 

Isolated 
Boys 
Girls 8 
Both sexes 14 


* Significant at .05 level. 


* Significant at .005 level. 


lag 
’ 
| “4, 
= 
7 0 3 
4 5 1 
1 8 1 
4* 13* 3* 


é 
Correvates oF Sociat IsoLaTION 41 


# < .005). This indicates that the hy- 
pothesis may have some validity as far 
as boys are concerned and suggests the 
desirability of further experimentation. 
There is no support, however, for the 
hypothesis that accepted girls progress 
more rapidly than isolated girls in the 
learning of sex role. 

The confirmation of both the second 
and third hypotheses, relating to uncer- 
tainty as to other’s reactions and free- 
dom to communicate, lends credence to 
Sullivan’s belief that a vicious circle 
may be created. The anxiety engen- 
dered by mistakes due to misconceptions 
may lead to failure to clarify concepts 
through open discussion and hence to 
further misconceptions. Many others 
including Murphy (1947) and Dollard 
and Miller (1950) have stressed the 
damage to personality which may result 
from such a situation. 

In the present study, the hypotheses 
discussed in the preceding paragraph 
were tested only in relation to communi- 
cation with an adult. In view of the fact 
that much learning at all ages is held 
to result from interaction with age 
peers, an important question arises as to 
whether the findings would have been 
the same had verbal communication 
with other children been tested. Studies 
by Bonney (1955) and Hahn (1948) 
suggest that this would have been the 
case. 

The confirmation of the hypothesized 
relationship between eye-hand coordi- 
nation and social status leads to a more 
general question as to whether a similar 
relationship exists at the age studied in 
respect to motor development in gen- 
eral. Other studies (Hunt & Solomon, 
1942; Tuddenham, 1951) suggest that 
this may well be the case. 

An additional exploration was under- 
taken as a part of this research. The 
cooperating teachers were asked to 
make ratings of general coordination on 


all children remaining in the accepted 
or isolated groups after those who were 
ineligible because of intelligence or 
socioeconomic status had been elimi- 
nated. The ratings were on a five-point 
scale and were based on the teachers’ 
impressions. The results shown in 
Table 6 makes it evident that a signifi- 
cantly greater proportion of accepted 
children were considered well coordi- 
nated by their teachers (x* = 7.59, 
df = 2, p < .025). 


CONCLUSIONS 


The results of this study lend support 
to Sullivan’s theories concerning char- 
acteristics associated with social isola- 
tion in the early school years. While the 
hypothesis of a positive relationship be- 
tween social status and the learning of 
sex role was not supported, a question 
is raised as to the possibility that such 
a relationship may exist in the case of 
boys. 

The hypotheses concerning the uncer- 
tainty of isolated children in regard to 
the reactions of others and their inhi- 
bition in verbal communication were 


TABLE 6 


Ratincs OF Motor CoorbDINATION AS 
DETERMINED BY TEACHER OBSERVATION 


Number of children rated 


Above 


average 


= 


Social status Average average 


Accepted 
Boys 22 10 
Girls 11 
Both sexes | 33 

Isolated 
Boys 17 
Girls 12 
Both sexes | 29 


* Significant at .025 level. 
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confirmed. It is felt that they acquire 
special importance when considered in 
the light of Sullivan’s belief that under 
these circumstances a vicious circle may 
be created. Due to fear of error and 
ridicule, the child may fail to expose 
himself to corrective or new learning 
with unfortunate results. 

A positive relationship between social 
status and eye-hand coordination was 
found in the groups studied. Additional 
evidence and other studies suggest that 
the same relationship may exist in re- 
spect to motor development in general. 
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PERSONAL PREFERENCE FOR METHOD AS A 
FACTOR IN LEARNING' 


NEWTON E. JAMES 


Student Counseling Bureau, University of Arizona 


Do individuals who learn material utilizing a preferred method actu- 
ally learn better than those utilizing a method other than their choice ? 
A total of 503 basic airmen at Lackland Air Force Base were grouped 
according to expressed preference between reading and lecture as 
modes of receiving elementary Air Force technical training prose. 
Each group was then subdivided randomly, one segment being given 
learning material utilizing the mode of choice with the other segment 


utilizing a different mode. 


No differences were found on posttests 


between Ss receiving material in mode of choice and those receiving 
material in mode unlike that chosen. 


The search for efficient ways in which 
to teach people to acquire new knowl- 
edge frequently leads over well-worn 
pathways, few of which have had more 
traffic than those supporting the investi- 
gation of modes of presentation of 
learning materials. For almost three- 
quarters of a century, there has been 
accumulating an extensive literature on 
the sensory and cognitive processes with 
much attention directed to the problem 
of accurately describing or comparing 
the learning which takes place when the 
learning material is presented visually 
and that which takes place when the 
material is presented in auditory form. 
(Brown, 1948; Carlson & Carr, 1938; 
Day & Beach, 1950; Elliott, 1936; 
Greene, 1928, 1934; Hollingworth, 


! This article is based on a PhD disserta- 
tion submitted in 1958 to the Graduate 
School of the University of Minnesota. The 
author wishes to express his appreciation for 
the guidance received from his advisors, Ruth 
Eckert, Gordon M. A. Mork, and C. Gilbert 
Wrenn. The study program of which the 
dissertation is a part was sponosored by the 
Air Force Institute of Technology and the 
experimentation was conducted by personnel 
of the Air Force Personnel and Training 
Research Center. Acknowledgment of valu- 
able assistance is made from these organiza- 
tions and from Edwin S. Ewart, Marion E. 
Hook, and Dee W. Norton, all formerly of 
the latter organization. 


1935; Stenius, 1945; Webb & Wallon 
1956) 

Since the early investigations of this 
type the technical advances in commu- 
nications media have produced far 
reaching changes in the reading and 
listening habits of the American public. 
With the emergence of radio and tele- 
vision as mass media there were exten- 
sive changes in the amount of practice 
or informal training which persons re- 
ceived in reading and listening. The 
facilitation of learning which might be 
expected due to increased practice may 
have been offset by the cultivated in- 
attention which people have acquired 
as members of the mass media captive 
audience (Meyersohn, 1957). Conse- 
quently, it is difficult to estimate what 
changes technological developments in 
communications have made in the abil- 
ity of individuals to learn by reading or 
by listening. 

A theoretical concept which has at- 
tained considerable popularity during 
the past decade, and the concept which 
prompts this study, contains the general 
idea that the image which a person has 
of himself is a motivating factor in his 
behavior and determines, to a certain 
extent at least, the conditions and extent 
of his learning (Benjamins, 1950; Lecky, 
1951). By implication it follows that 
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when a person is given learning material 
in a manner which he thinks is advan- 
tageous to him, he will perform better 
than he would have performed had the 
material been presented in another 
manner. The specific problem to which 
this study is addressed is contained in 
the following question: Do individuals 
who are given learning material by the 
mode of their preference actually learn 
better than those individuals who are 
given the material in a mode unlike 
their choice? 


PROCEDURE 


Subjects were basic airmen recently in- 
ducted and in training at Lackland Air Force 
Base, Texas, in June 1957. The average age 
of individuals in the sample was 18 years 
and on the Armed Forces Qualifying Test 
(AFQT), a nationally standardized measure 
of general learning ability, the mean of the 
group was at the sixty-fourth percentile. The 
educational level of the group was not tab- 
ulated but in view of the high mean on the 
ability measure and the time of year at 
which the sample was drawn, it is inferred 
that the group contained many new high 
school graduates and also a number of col- 
lege students who had chosen to interrupt 
their formal education at that time. 

On each of 4 successive days subjects were 
received in groups for testing. These groups 
varied in size from 75 to 170 airmen; no 
individual appeared more than once. Each 
of the groups was treated in an identical 
manner and all testing was done between 
7:30 and 9:00 a.m. in large, well-ventilated, 
well-lighted classrooms. 

Each group was assembled in a large class- 
room where, after a brief introduction, a pre- 
test of aviation information was administered. 
The purpose of this test was to determine 
the amount of prior knowledge which each 
individual had concerning the learning mate- 
rial which was to be presented in the ex- 
perimental situation. 

Following the pretest and a brief ®xplana- 
tion of the study, the subjects were asked to 
indicate which of two modes of presenting 
technical learning material they preferred. 
The choices offered were: (a) I prefer a 
reading presentation, (6) I prefer a lecture 
presentation, and (c) I have no preference. 


Subjects were assigned then to groups accord- 
ing to the choices which they expressed. 
These groups are subsequently referred to 
as the choice groups. 

Each choice group was then divided ran- 
domly into two groups of equal size and 
after additional introductory and explana- 
tory remarks one group was given a written 
presentation of the learning material and 
the other group was given the same material 
over a public address system from a tape 
recording. Immediately following each pre- 
sentation all groups were tested with a writ- 
ten multiple-choice test. These groups are 
subsequently referred to as the choice-treat- 
ment groups. 

Scores on the AFQT, the general aptitude 
measure previously mentioned, were available 
for all the subjects. On the basis of these 
scores, the choice-treatment groups were 
each divided into two groups consisting of 
those individuals with scores above the group 
mean and those with scores below the mean. 
The division of the experimental group into 
subgroups is indicated in Figure 1. 

The learning material and posttest were 
taken directly from a reading comprehension 
test which had been developed in the avia- 
tion psychology program of the Air Force. 
The test consisted of seven paragraphs of 
narrative prose, 200-400 words in length, on 
diverse technical scientific and _ historical 
subjects within the field of military aviation. 
Each paragraph was followed by a five-item 
multiple-choice question. ‘The total num- 
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ber of questions was 30 and the time allotted 
to the test when given in its original form as 
a silent reading test was 35 minutes. 

The readability of the material, as meas- 
ured by current formulae, was more difficult 
than that which persons of the age and edu- 
cational level of basic airmen can be expected 
to read with 75% comprehension. However, 
the paragraphs of the material are typical of 
those found in textbooks for beginning tech- 
nical courses in which basic airmen are 
enrolled. 

The test was given to half of the subjects 
as a silent reading test ard to the remainder 
of the subjects as a tape recorded presenta- 
tion over a public address system. In each 
case the material was presented in revised 
form, one paragraph at a time, with the 
requirement that the subject read or listen 
to the material and immediately thereafter 
answer the questions pertaining thereto. All 
subjects were allowed 22 minutes to read 
or listen to the material and 22 minutes to 
answer the questions on each paragraph. 
Tests were scored on the basis of number of 
questions answered correctly. There was no 
correction made for guessing. 

A three-dimensional factorial design was 
employed, and analysis of variance applied 
to both the pretest and posttest scores. The 
variables in the analysis were as follows: 

1. subject’s choice of mode of presenta- 
tion of learning material, viz., reading, lec- 
tures, or no preferences 

2. subject’s AFQT score, viz., above group 
mean, or below group mean 

3. actual mode of presentation of learning 
material, viz., reading, or lecture (tape re- 
corded ) 

Null hypotheses were tested for each of the 
above three variables and for each possible 
interaction. 


RESULTS 


Analysis of the pretest data revealed 
no statistically significant differences be- 
tween the experimental groups except 
those due to differences in AFQT scores. 
A summary of analysis of posttest data 
is given in Table 1. 

Detailed description of the findings 
appears in the following paragraphs. 
Letters in parentheses refer to sources 
of variation reported in Table |. 

1. No differences were found in the 


TABLE 1 


Posttrest Data: SUMMARY OF 
ANALYSIS OF VARIANCE 


Source of 
variation dj SS 


A (Choice) 
B (Level) 
C (Mode) 


56.78 
3181.31 
550.27 


2 28.39 

1 

2 55.71 

1 

2 

2 


3181.31 
550.27 
27.86 
67.84 
57.97 
2.54 


67.84 
115.94 
5.07 
Within 
cells 356 6346.98 
Total 367 10379.90 


17.83 


* Significant at the .05 level (the maximum proba- 
bility of Type I error). 


scores of those subjects who preferred 
reading, those who preferred lecture, 
and those who stated no preference. (A) 

2. Differences in scores indicated the 
superiority of individuals in the upper 
category of AFQT scores over those in 
the lower AFQT category. These dif- 
ferences are significant at the .01 level. 
(B) 

3. For the sample as a whole, the 
reading presentation produced higher 
scores than did the lecture presentation. 
The differences are significant at the 
05 level. (C) 

4. There is no significant interaction 
between choice of presentation and 
category of AFQT score. That is to say, 
preference for a given mode does not 
appear to be any more potent factor for 
one level of ability than for the other. 
In neither group are these meaningful 
differences in scores between those who 
chose one method and those who chose 
another. (AB) 

5. There is an interaction between 
the subjects’ expressed choice and the 
mode of presenting the learning mate- 
rial which is statistically significant at 
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the .05 level. This interaction does not 
operate, however, to produce signifi- 
cant differences in scores on the cri- 
terion measure between groups of sub- 
jects who received the learning material 
in the preferred mode of presentation 
and those who were given the material 
in a different mode or between these 
groups, and the students who expressed 
no preference. (BC) 

Means and standard deviations of the 
experimental groups appear in Table 2. 

In each of these three groups, 42 sub- 
jects received the written presentation 
and 72 the lecture; half the subjects in 
each group were above the sixty-fifth 
percentile on national norms of the 
aptitude test employed and half were at 
or below this figure. There are no dif- 
ferences between any two of the above 
groups which are statistically significant 
at the .05 level. 

6. The superiority of high ability 
over lower ability groups was more 
pronounced with the reading than the 
lecture presentation. This interaction 
between the aptitude test score and 
mode of presentation is significant at 
the .05 level of confidence. (AC) 

7. There is no significant triple inter- 
action between the variables. That is to 
say, there is no meaningful relationship 
between preference of mode of presen- 


TABLE 2 


SuMMARY OF SCORES 


Group Mode of presentation MS SD 
1 In accordance with 
subject’s choice 17.34 5.31 
2 Contrary to subject's 
choice 17.10 4.96 


3 Neutral with respect 
to subject’s choice, 
i.e., subject stated no 
preference 18.00 5.54 


tation, aptitude test score, and response 
to the mode of presentation employed. 
(ABC) 


CONCLUSION 


1. When individuals are of equal in- 
telligence, the learning of those who 
prefer the reading presentation is not 
significantly different from that of those 
who prefer the lecture presentation. 
However, as has been noted by other 
investigators, there is probably a differ- 
ence in the achievement of people in 
general who choose the reading method 
and those who choose the lecture 
method. In the present study, it is note- 
worthy that apparently 40% of the total 
sample preferred the lecture presenta- 
tion, 20% preferred the reading presen- 
tation, and 40% had no preference. 
Greene (1928, 1934), and other investi- 
gators have reported that the brighter 
students and the good readers preferred 
the reading method whereas the medi- 
ocre or duller students preferred the 
lecture. This finding seems to be sup- 
ported in the present investigation, for 
47% of the airmen who chose the read- 
ing presentation were in the upper cate- 
gory of the aptitude measure while only 
38% of those who chose the lecture 
presentation were in the upper category. 
However, 52% of the airmen who ex- 
pressed no preference were in the upper 
category of ability. 

2. For the type of material which 
must be taught in Air Force technical 
schools the reading presentation has 
certain advantages that cannot be ig- 
nored. A certain amount of such mate- 
rial probably must be presented in this 
manner. The reading is difficult, as 
measured by formulae of reading ease, 
and involves unrelated factual items 
that require visual reference and con- 
venient referability. The superiority of 
the reading presentation over the simu- 
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lated lecture presentation for the mate- 
rials and subjects of this study is clearly 
established. It is likely that the substi- 
tution of a good, interesting lecturer for 
the tape recording would add consider- 
ably to the effectiveness of the lecture 
presentation. Yet, it seems equally likely 
that the substitution of a good, well- 
illustrated text or manual, complete 
with diagrams, figures, and index for 
the present written material would also 
increase the effectiveness of the reading 
presentation. 

3. There appear to be no meaningful 
differences between individuals in the 
higher category of AFQT scores and 
those in the lower category with respect 
to the relationship between their choice 
of mode and their achievement. Choice 
of mode seems to make no difference in 


the criterion test scores in either AFQT | 


category. 

4. The findings suggest that when 
material is to be used for test purposes, 
a reading presentation brings out the 
differences between groups to a greater 
extent than does the lecture presenta- 
tion. 

5. Although the interaction between 
choice and mode of presentation is sta- 
tistically significant at the .05 level, 
there are no significant differences be- 
tween any two of the subgroups. The 
learning of the groups that received the 
material in the preferred mode was not 
significantly different from that of 
groups that received the material in a 
mode unlike that chosen. The differences 
between these definite choice groups and 
the groups that expressed no preference 
were likewise significant neither from 
the practical standpoint nor statistically 
at the .05 level. Consequently it is con- 
cluded that in comparison with other 
factors which affect the learning situ- 
ation, whether or not a person gets his 


favored mode appears to be of relatively 
little importance. The variation in 
scores on the criterion measure which 
can be attributed to differences in gen- 
eral intelligence is over fifty times as 
great as that which can be attributed 
to the choice and mode interaction 
factor. 
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A cross-sectional study of changing values of medical school students 
was performed by administering a values test, the Survey of Interper- 
sonal Values, to all members of the Ist through 4th year classes in a 
large medical school. A predicted decrease in Benevolence, from the 
Ist through the 4th year, was found. Significant increases in Support, 
Recognition, and Independence and a significant decrease in Con- 
formity were also noted. The present findings have implications for 
the practice of applying personality data obtained on occupational 
groups to high school or college counselees. 


A number of studies support the point 
of view, popularly held among medical 
school teachers, that the medical stu- 
dent, as he moves from his first through 
his fourth year, becomes less “idealistic” 
and more “cynical.” In one of these, 
Eron (1955) surveyed attitudes of med- 
ical students and found that, year by 
year, students did, in fact, score higher 
on “cynicism” and lower on “humani- 
tarianism.” Becker and Geer (1958), 
in a 4-year longitudinal study of a group 
of medical students, using interview and 
observational techniques, also noted a 
shift away from idealism. They inter- 
preted their findings as being indicative 
of the students becoming increasingly 
concerned with the technical aspects of 
their cases, and less interested in “help- 
ing the sick” or “sympathizing” with 
their patients. Kelley (Gee & Cowles, 
1957) also noted this general lack of 
interest on the part of medical students 
in the welfare of human beings. 


1 Opinions expressed are those of the au- 
thors and do not necessarily reflect those of 
the Department of the Navy. 

2?Grateful acknowledgment is made to 
Faye E. Barnes, Marielle Fuller, Ada Hirsch- 
man, Evelyn Kaslow, and Mary Linn Thoma- 
son for their assistance in the processing of 
the data. 


The Survey of Interpersonal Values 
(SIV) (Gordon, 1960) is a brief forced- 
choice test designed to measure the rela- 
tive importance which one ascribes to 
each of six factored interpersonal value 
dimensions. One of the values included 
in this test, Benevolence, provides a 
measure which appears to be related to 
the humanitarianism or idealism re- 
ferred to by Eron, and Becker and Geer. 
The six values are defined as follows: 

Support—Being treated with under- 
standing, receiving encouragement from 
other people, being treated with kind- 
ness and consideration. 

Conformity—Doing what is socially 
correct, following regulations closely, 
doing what is accepted and proper, 
being a conformist. 

Recognition—Being looked up to and 
admired, being considered important, 
attracting favorable notice, achieving 
recognition. 

Independence—Having the right to 
do whatever one wants to do, being 
free to make one’s own decisions, being 
able to do things in one’s own way. 

Benevolence—Doing things for other 
people, sharing with others, helping the 
unfortunate, being generous. 

Leadership—Being in charge of other 
people, having authority over others, 
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being in a position of leadership or 
power. 

The present study was performed to 
determine whether a downward trend 
would, in fact be found from the first 
through the fourth year on that aspect 
of idealism measured by the Benevo- 
lence scale of the Survey of Interper- 
sonal Values. In addition, it was desired 
to determine whether trends would be 
observed for interpersonal values other 
than Benevolence, since it appeared to 
be reasonable to assume that other val- 
ucs also might be affected. 


PROCEDURES AND RESULTS 


The SIV was administered to all students 
in the first through the fourth year classes 
of a large western medical school. Two hun- 
dred and eight male and 14 female students 
were included in the testing. Freshmen were 
tested in the beginning of their first year; 
the other classes were tested during the 
course of their academic year. In view of the 
small size of the female sample, analysis was 
restricted to the male student group. Means 
and standard deviations for the six interper- 
sonal values are presented, by class, in 
Table, 1. 

It was desired, first, to determine whether 
a downward trend existed from the first 
through the fourth year on the Benevolence 
value. Since it was reasonable to assume that 
any changes in values that did occur would 
be monotonic, following Lindquist (1953, p. 


TABLE 2 


MeAN DIFFERENCES AND SIGNIFICANCE 
LeveELs 


| | 
Fourth year—First year| Resident—First year 


| Mean | 
difference 


Mean 
t | difference 


62 
1.66* 
1.70* 
1.85 


1.29 
—5.64 
2.45 
4.30 
—5.86 
3.63" 


2.88** 
3.06** 
2.01* 
3.54 2.79" 
| —5.01 5.12* 
—1.19 92 


3.03 
—3.28 
2.79 


*One-tailed test. 

*The difference for Leadership is in the unexpect- 
ed direction. 

* Significant at .05 level. 

** Significant at .01 level. 


342), a significance test was performed be- 
tween Benevolence means of the first and 
fourth year groups only, The mean differ- 
ence between these two groups was found 
to be significant beyond the .01 level of con- 
fidence (Table 2), supporting the hypothesis 
that a downward trend occurs from year to 
year on the Benevolence scale. 

Tests of the significance of the differences 
between means of the two classes, for the 
other five values, were performed next. 
Mean differences were found to be statisti- 
cally significant (Table 2) for four out of 


TABLE 1 


MEANS AND STANDARD DeviATIONS FOR First THROUGH FourTH YEAR MALE 


MepicaL STUDENTS AND Mate Psycuiatric ReEsmmeENTs ON THE SIV 


Means 


Standard deviations 


Group 
Cc 


13.39 12.97 10.88 
17.86 
17.31 
16.42 
14.68 


First year 
Second year 
Third year 
Fourth year 
Residents 10 


18.26 18.08 16.26 
9.84 12.27 20.57 15.57 13.84 
8.21 11.77 21.77 14.67 16.44 
9.69 13.67 21.80 13.07 15.07 
7.33 13.33 22.56 12.22 19.89 


5.69 6.34 4.83 6.77 4.98 6.14 
4.35 5.37 3.60 7.17 5.00 4.55 
4.73 5.05 4.48 5.75 4.99 4.95 
5.19 4.83 4.68 6.54 5.04 6.95 
5.86 5.31 4.06 7.16 4.60 5.44 


Note.—S = Support, C = Conformity, R = Recognition, I = Independence, B = Benevolence, L = Leadership. 
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the five remaining values. Fourth year stu- 


dents place a higher value on Independence, 
Recognition, and Support than do first year 
students, but value Conformity less. No sig- 
nificant difference was found between classes 
on Leadership. 

A group of 10 psychiatric residents, who 
had just completed their internship, and who 
were at the same medical facility as the 
medical students, were also administered 
the SIV. Means and standard deviations 
for this group are presented in Table 1, As 
a matter of interest, significance tests were 
run to determine whether differences previ- 
ously found between the first and fourth 
year groups would also be found between the 
first year and resident groups. Since a par- 
ticular directionality was being tested for 
each difference, one-tailed tests of signifi- 
cance were used. As may be noted in Table 
2, for all five values on which significant 
mean differences had been previously found, 
differences between first year students and 
residents were in the same direction as the 
previous differences. Four of these differ- 
ences were significant at or beyond the .05 
level of confidence. 

It may be noted that sharper differences 
in mean value scores occur between first and 
second year students than between other 
consecutive year groups. These differences 
are not due to first year attrition, since, for 
the present freshman class only four students 
failed and differences between classes with 
these students excluded are essentially the 
same as those presently found.* The larger 
differences between first and second year stu- 
dents are in accord with Freedman’s findings 
(1961), that personality changes during col- 
lege training are not linear from year to year 
but tend to take place quite early. 


DISCUSSION 


The present study confirms the find- 
ings of other investigators that from the 
first year on, being benevolent, in the 
sense of wanting to help other people, 
becomes decreasingly important to the 
medical student. This downward shift 
in Benevolence is consistent throughout 


8 Differences between means of all students 
and passing students averaged .1. The sam- 
ple size of the first year group reflects a 50% 
expansion in the freshmen class over previous 


years. 
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medical school training and seems to 
carry on beyond graduation. Whether 
this trend continues into medical prac- 
tice, of course, cannot be ascertained 
from the present study. 

The decline in Benevolence exhibited 
by medical students during their course 
of training need not be too disconcert- 
ing. The average entering medical stu- 
dent has a percentile rank on Benevo- 
lence of 70 on male college norms, 75 
on engineering norms, and 84 on mid- 
dle management norms. In his fourth 
year of medical training, his percentile 
rank is now 44, 47, and 54, respectively, 
on these three sets of norms. Thus while 
the beginning student is, indeed, rather 
idealistic in his desire to help his fellow- 
man, as graduation nears, he is probably 
no less benevolent than the average 
adult male. 

Equally interesting are other syste- 
matic differences which are suggested 
by the present data. The most consist- 
ent trend, other than the decrease in 
Benevolence, is found in the medical 
student’s increased valuing of Inde- 
pendence as he progresses through med- 
ical school training. In addition, an 
increase in his valuing of Recognition 
may be noted. On the other hand, con- 
forming behavior becomes less impor- 
tant to him. The drop in both Benevo- 
lence and Conformity may reflect an 
increase in problem orientation, and a 
decrease in social orientation, on the 
part of the medical student, as Becker 
and Geer have suggested. He may feel 
the need for a more impersonal relation- 
ship toward his patients, as well as a 
greater freedom from societal restraints. 
While these are a posteriori specula- 
tions, they do present hypotheses that 
merit further investigation if a broader 
understanding of value changes which 
occur during medical school training is 
to be achieved. 

Present findings should also caution the 
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guidance counselor against the uncriti- 
cal use of personality profiles obtained 
on job incumbents with high school or 
college freshman counselees. Successful 
or vogationally adjusted job incumbents 
may have quite different traits or values 
from what they had prior to their aca- 
demic or vocational training. Utiliza- 
tion of personality profile data for voca- 
tional guidance purposes should follow 
a prior determination of the stability of 
relevant dimensions by cross-sectional or, 
preferably, longitudinal investigations. 
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3 NEW TEXTS ON HOW HE DEVELOPS, HOW HE LEARNS 


CHILD DEVELOPMENT 


AND ADJUSTMENT: 
A Study of Child Psychology 


By Lester D. Crow, Brooklyn College, 
and Alice Crow 


This text covers every significant aspect in 
the development of the normal child, from 
pre-natal stages through early adolescence, 
incorporating the results of the latest re- 
search studies. Each aspect of develop- 
ment is treated as an integral part of the 
development of the whole child. Physical, 
mental, and emotional growth, as well as 
motor, language, and social development 
are discussed in relation to each other and 
to the total personality pattern. In addi- 
tion, materials are continually correlated 
with other areas of psychology. 

1961, 515 pages, $6.50 


EDUCATIONAL 


PSYCHOLOGY, 
Revised Edition 
By Glenn Myers Blair, R. Stewart 
Jones, and Ray H. Simpson, all, Uni- 
versity of Illinois 
The latest edition of this text covers the 
facts, principles, and methods that lead to 


a sound psychological foundation for ef- 
fective teaching. It features up-to-date re- 


search on teaching machines, feedback, 
“brainstorming,” creative thinking, and 
discovery and learning. Pictures of class- 
room learning activities, lists of new in- 
structional films, and end-of-chapter exer- 
cises offer concrete suggesions, and a 
teacher’s manual provides excellent test- 


ing devices. 
February, 1962 


READINGS IN 
EDUCATIONAL 


PSYCHOLOGY 


Edited by Victor H. Noll and Rachel 
P. Noll, both, Michigan State 
University 


A completely up-to-date book of readings 
designed to supplement any standard text, 
this volume includes selections on growth 
and development, learning, measurement 
and evaluation, mental hygiene, and the 
science of educational psychology. Alter- 
nate viewpoints are presented on major 
topics, and the emphasis is on articles that 
incorporate the latest research studies. 


April, 1962 


THE MACMILLAN COMPANY 
60 Fifth Avenue, New York 11, New York 
A Division of 
The Crowell-Collier Publishing Company 
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Psychology 
and Mental Health 


A report of the Institute on Education and Training 
for Psychological Contributions to Mental Health, 
held at Stanford University in August, 1955. 


Edited by CHARLES R. STROTHER 


Topics discussed at the Institute: 


Training Needs of Psychologists in Com- 
munity Mental Health 


Specialization in Training 
Practicum Training 
Training for Therapy 


Training for Research in the Mental 
Health Field 


Problems of Departmental Organization 


Price: $1.75 


Order from: 


American Psychological Association, Inc. 
1333 Sixteenth Street, N. W. 
Washington 6, D. C. 
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outstanding 


books from 


Wadsworth: 


PSYCHOLOGY A Scientific Study of Man 
by Fillmore Sanford, University of Texas 


This brilliant textbook for the beginning student of psychology presents with 
clarity and excitement challenging material that imparts an intellectual appre- 
ciation for and a detailed understanding of psychology. Emphasis is placed on 
the methods of psychology and their relation to the intellectual and social life 
of our culture. 

Clothbound 8 x 1044” 588 pages text list $7.50 


Workbook Paperbound 81x11” 256 pages text list $2.50 
Teacher's manual available upon adoption. 


EDUCATIONAL PSYCHOLOGY 
by Frederick J. McDonald, Stanford University 


Within a very short time this book has become a leader in the field of educa- 
tional psychology textbooks. Its mew approach emphasizes the teacher as a 
hypothesis maker—as one who uses the framework of psychology to formulate, 
test, and evaluate teaching methods related to the development of personality 
in the child. 


Clothbound x 9%” 768 pages text list $6.95 
Teacher's manual available upon adoption 


For further information you are invited to write 


Wadsworth Publishing Co. W 


Belmont, California 
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ANNOUNCING 


we Journal OF 


Bi-monthly from January 1962 
Annual subscription 

A.P.A. member rate 

A.S.1.D. member rate 

Student rate 


The Journal of Mathetics 


The Journal of Mathetics 


Carrot, Dunn 
Executive Editor 


Tuomas F. 
Editor in Chief 


Editorial Advisors 


Joun A. Bartow Cuartes B. Ferster Paut S. Siece. 
Joseru V. Bravy  Israet Gotpiamonp W. Stack 


Papers of profound interest to educators on new 
applications of reinforcement theory are becoming 
available in growing numbers. 

The Journal of Mathetics fills the need for an 
organ devoted to their collection. 

It gives the scientists in this field a publication 
of professional standing in which they may discuss 
their own work and keep informed on the findings 
of their contemporaries. 


Box 3232 E University, Alabama 
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ELEMENTARY STATISTICAL METHODS IN 
PSYCHOLOGY AND EDUCATION 
Paul Blommers and E. F. Lindquist 
“This seems to me an excellent elementary text which main- 
tains the balance I think necessary between mathematical 
vigor and intuitive argument. . . ."—Jacob Cohen, New York 
University. 528 pp. 1960 $6.00. Accompanying Study 
Manual and Instructor's Key. 


PSYCHOLOGY IN TEACHING 

AND LEARNING 
William Clark Trow 
“. .. Mr. Trow has done what | consider an excellent job 
both from the standpoint of interesting material and de- 
sign. . . ."—E. O. Wood, Baylor University, 488 pp. 1960 
$5.75. Accompanying Student's Manual and Instructor’s 
Handbook. 


Houghton Mifflin 


NEW ATLANTA 
CG ENEVA mu DALLAS PALO ALTO 
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BOOKS 


Just out — the new SECOND EDITION of 


EDUCATIONAL PSYCHOLOGY 
IN THE CLASSROOM 


By Henry Cray LINDGREN, San Francisco State College. A sound, 
thorough revision of a popular, c/assroom-oriented text; in this edition 
Lindgren sharpens his idea of the teacher functioning as a behavioral 
scientist. Emphasizing the social and emotional factors that affect 
learning, the book is firmly based on laboratory experience and research, 
and reflects the most modern thinking on the subject. New in the 
Second Edition: increased attention to motivation and the under- 
achiever . . . stress on secondary school problems . . . revision of 
testing and evaluation material . . . more coverage on special education 


and automated teaching . . . a new — on discipline. Student 
workbook and instructor's manual available. 
1962 574 pages $6.95 


Send now for your on-approval copy 


JOHN WILEY & SONS, Inc. 
440 PARK AVENUE SOUTH, NEW YORK 16, N. Y. 
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